53 results about "XPath" patented technology

The invention discloses an intelligent element positioning method and system based on AI and a dynamic feature library, and the method comprises the steps: carrying out the anomaly detection and abnormal data capture, executing an element positioning operation through an automatic script, and recording a page DOM tree structured snapshot when the positioning is judged to be failed; multi-modal feature extraction: analyzing the DOM tree, and extracting an XPath / CSS path and semantic attributes of a target element; performing dynamic feature library retrieval and matching, calculating DOM structure similarity, and taking a high-similarity rule as a correction basis if the high-similarity rule exists; an AI intelligent rule is generated, and candidate positioning rules are generated through the classification model; performing script correction and real-time feedback, replacing the failure positioning statement and updating the dynamic feature library; and generating a structured report, and recording abnormal data. According to the method, the AI is combined with the dynamic feature library, so that the intelligent correction of element positioning in the automatic test process is realized, and the stability and efficiency of the automatic test are improved.

The invention discloses an RPA code generation method based on an HTML and an image, and the method comprises the following steps: S1, receiving multi-modal input data provided by a user, the multi-modal input data comprising an HTML structure file of a target business system, an interface screenshot image and a natural language operation demand description; s2, performing standardized analysis on the HTML structure file, extracting DOM tree structure information, and performing visual feature enhancement processing on the interface screenshot image; and S3, inputting the processed HTML structure information, the interface screenshot image and the natural language operation requirement into a pre-trained visual language model, and outputting a target XPath path and a Python code sequence through the visual language model. According to the method, comprehensive understanding of a complex service system is realized by combining HTML structure information and an interface image, so that efficient and accurate RPA script codes capable of being executed on multiple platforms are automatically generated.

The invention relates to the technical field of computer network data acquisition and processing, in particular to an intelligent news crawling system and method based on SpiderFlow, and the system comprises a dynamic time control module, an intelligent duplicate removal module, a paging processing module, a fault-tolerant data extraction module and a dynamic parameter configuration module. The dynamic time control module generates a time variable through a date calculation engine to realize accurate limitation of a crawling time range; the intelligent deduplication module adopts a three-level deduplication mechanism to ensure data uniqueness; the paging processing module supports static parameter and dynamic AJAX loading dual-mode paging, and realizes full-amount acquisition in combination with a self-increasing page number iterator and an intelligent termination strategy; the fault-tolerant data extraction module is integrated with CSS / XPath double parsers, and data integrity is guaranteed through field missing detection and messy code transcoding. Through multi-module cooperation and an intelligent algorithm, crawling efficiency, data quality and system stability are remarkably improved, and challenges such as webpage structure change and anti-crawling limitation are effectively handled.

The invention relates to a multi-modal interaction-oriented automatic operation backtracking and digital person continuous talking control method and system, and the system comprises an operation snapshot module which records operation nodes through a semantic anchor point marking technology, such as an interface XPath page number and a PPT page number; the interruption detection module is used for capturing a user interruption instruction in real time; the progress prediction engine dynamically adjusts a follow-up demonstration path based on a program; and the continuous talk controller is used for coordinating RPA operation execution, digital human rendering and voice synthesis through a three-level priority thread pool. The problems of inaccurate operation flow backtracking and multi-modal thread conflict after demonstration interruption are solved, the breakpoint continuous talk error is obviously lower than that of a traditional scheme, and the method is suitable for PPT demonstration, cockpit explanation, business system training, course explanation and 3D modeling guidance scenes.

The invention belongs to the technical field of network data processing, and particularly relates to a network data capture and anomaly detection method based on artificial intelligence. Aiming at the defects in the aspect of network data processing in the prior art, the method comprises the following steps: firstly screening an initial URL list to remove invalid low-value URLs, then identifying a webpage data area by using a model fusing the advantages of a CNN and an RNN, generating an extraction path by using a dynamic XPath algorithm, then calculating fingerprint comparison differences by using a multi-granularity Hash algorithm, and finally detecting data exception in combination with improved DBN and IF algorithms. The method can adapt to complex webpage structure changes, accurately capture data, accurately identify data updating or newly adding, effectively detect abnormal modes, improve data processing efficiency, accuracy and safety, and provide a reliable solution for network data processing.

The invention discloses a vertical website information extraction method and device based on a large model, equipment and a medium. According to the technical scheme provided by the invention, the method comprises the following steps: extracting first attribute text information corresponding to a target attribute from a seed webpage selected from a vertical domain website by utilizing a large language model; screening correct nodes from the nodes corresponding to the information, and determining an absolute path expression of XPath of the correct nodes; determining anchor nodes from the DOM tree based on the absolute path expression, and constructing an XPath final expression based on the relative positions of the correct nodes and the anchor nodes; and extracting second attribute text information corresponding to the target attribute from the vertical domain website by utilizing the XPath final expression. According to the method, the correct node and the anchor node are determined through the seed webpage in the vertical domain website, and the target information is extracted from the website through the XPath final expression obtained through the relative positions of the correct node and the anchor node, so that the target information is extracted more accurately with lower cost under the condition that model training is not needed.

The invention discloses a large language model XPath generation method based on hierarchical composite reward reinforcement learning, and the method specifically comprises the following steps: 1, obtaining HTML (Hypertext Markup Language) source codes and page element information of a target webpage, carrying out the data cleaning, and obtaining structured data containing a DOM (Document Object Model) hierarchical sequence structure and an element attribute value; performing data annotation on the structured data after data cleaning to obtain an annotated data set; 2, selecting a basic model, performing supervision and fine tuning on the basic model by using the annotation data set, and taking the basic model subjected to supervision and fine tuning as a strategy model; constructing a layered composite reward function to perform reinforcement learning fine tuning, so that the output hierarchy of the strategy model is aligned with the input DOM hierarchy, and obtaining a final model subjected to two-stage fine tuning; and 3, generating a standard XPath character string, and outputting structured data matched with the input DOM hierarchy to display layer-by-layer construction logic of the standard XPath character string. According to the method, the stable XPath can be generated, and the generation process is completely transparent and traceable.

The invention provides an automatic test script generation method and device and a storage medium, and the method comprises the steps: obtaining an initial automatic test script, and analyzing the initial automatic test script to extract an initial XPath path; obtaining to-be-tested webpage content, and analyzing the webpage content to generate a DOM tree of the to-be-tested webpage; based on the initial XPath path, determining a corresponding test script data table; establishing a webpage element matrix model based on the DOM tree; and optimizing the initial XPath path on the basis of the test script data table and the webpage element matrix model to obtain a target XPath path, and generating a target UI automatic test script on the basis of the target XPath path. Therefore, the initial XPath path can be automatically adjusted through the test script data table and the webpage element matrix model, the target XPath path is obtained, manual adjustment is not needed, the generation efficiency and accuracy of the test script are improved, and then the UI test efficiency and accuracy are improved.

An AI-driven, self-healing test automation system for WebDriverIO (WDIO), comprising: a. an error catching layer configured to detect when a test step fails due to a missing, moved, or modified UI element; b. an AI-based detection engine configured to analyze the current Document Object Model (DOM), historical test execution data, and element attributes including XPath, CSS selectors, labels, and inner text to identify and evaluate potential alternative UI elements; c. a predictive recovery module that uses pre-trained models such as Long Short-Term Memory (LSTM) networks or transformer-based architectures to predict and select an appropriate recovery action based on the current test context, including repeating the operation, jumping to the next logical step, or redirecting the test flow; d. a dynamic healing process that automatically applies the selected recovery action without requiring manual updates to the test code; e. a feedback learning loop configured to update and retrain the detection and prediction models based on user validation, success metrics, and execution results, thereby improving the accuracy and adaptability of the system over time.

The invention belongs to the technical field of computers, and discloses a news detail page XPath automatic extraction method and system based on a large model, and the method comprises the steps: determining a large model base through multi-aspect evaluation; the method comprises the following steps: preprocessing an HTML page, designing a structured prompt template and constructing a thinking chain CoT data set; utilizing a Lora technology fine tuning model, and adopting a smooth loss function and a dual reward mechanism of fusion format and content evaluation to optimize; and performing format calibration on the XPath and the JSON output by the model, and extracting and verifying the validity of the URL of the detail page by using the calibrated XPath. Compared with a traditional template-based information extraction method, the method does not depend on the stability of a webpage structure, has higher generalization ability and fault tolerance, remarkably improves the information extraction precision, enhances the complex webpage adaptability, improves the overall robustness and universality of a system, and is suitable for large-scale popularization and application. And a stable extraction effect can still be kept in news websites with frequent structure change.

The invention discloses a webpage data extraction method based on a large language model, which comprises the following steps of: generating an Xpath sequence webpage grabber by utilizing the large language model, and processing diversified and variable network environments through a two-stage framework: in the first stage, inversely checking and removing HTML (Hypertext Markup Language) noise by utilizing LLM (Language Language Model) information extraction capability, and in the second stage, inversely checking and removing HTML (Hypertext Markup Language Model) noise; self-adaptive generation of an Xpath action sequence is carried out according to the hierarchical structure of the HTML; according to the combination of an external evaluation mechanism and a local evaluation mechanism of LLMs, a plurality of Xpath action sequences generated on different webpages in one stage are integrated, and a general grabber specific to a website is generated. According to the method, a baseline method is always exceeded under zero sample setting, higher efficiency is shown in large-scale webpage information extraction tasks, the method can quickly adapt to different website and task requirements, dependence on LLMs is reduced when similar tasks are processed, and therefore the efficiency of processing a large number of webpage tasks is improved.

The invention relates to the technical field of software UI automatic testing, in particular to a Web end UI automatic testing method based on a Selenium framework. Comprising the following steps: defining an Xmind icon, simplifying case writing in a keyword mode, packaging a case module, operating XPath multiplexing, providing element and interface return value assertion, defining an expandable constant method, and supporting a flexible JSON extractor and a tool business execution process; according to the method, Xmind files and keywords are combined to arrange use cases and are analyzed into UI automatic test codes with different functions, so that the test script compiling and maintaining difficulty is lowered, the professional ability requirement of technicians is lowered, use case implementation is simplified in the modes of module reuse, Xpath reuse and the like, and compared with an existing automatic test technology, repeated labor is reduced, and the test efficiency is improved. The coding time and cost are greatly reduced, the test efficiency is improved, and the effects of reducing cost and increasing efficiency are achieved.

The invention discloses a website data analysis method and device based on a large model technology, and belongs to the field of fusion of web crawlers and artificial intelligence. According to the method, a local knowledge base drives a large model to generate a precise XPath rule, and the precise XPath rule is packaged into a decoupling plug-in and integrated into an existing crawler framework; a dynamic feedback optimization mechanism is innovatively designed, rule validity is monitored in real time by using a composite verifier, and XPath reconstruction and knowledge base updating are automatically triggered. According to the method, the high concurrency performance of a traditional crawler is reserved, the rule generation efficiency and the system robustness are remarkably improved, the manual maintenance cost is reduced, and the method is suitable for a website data collection scene with a complex structure or frequent updating.

The present invention discloses a method and device for extracting Web page information based on attribute perception, which belongs to the technical field of web page information extraction. The method comprises: crawling the original web page data of a given target website, saving it as the original input of a model, preprocessing the data on the original data, removing useless label inputs in the original data such as scripts, and reducing the noise information of the input model; extracting variable nodes in the web page, constructing the token sequence and xpath sequence of the input model, and recording the position information of the sequence at the same time, adding an attribute perception embedding module on the basis of the pre-trained model, so that the pre-trained model can perceive the pattern information of the attribute, embedding the input information through a classification layer, and the model outputs the final result of the Web page information extraction. The method can improve the accuracy of Web page information extraction, provide rich structured knowledge for downstream tasks, and promote the development of downstream tasks.

The present invention discloses a method and device for positioning and interacting UI elements based on keyword driving, comprising: obtaining a written test case; using a keyword syntax matching algorithm to obtain the parent element where the target element is located, the child element where the target element is located, and the characteristic value of the target element in the test case, and obtaining the characteristic value of the target action in the test case; using a positioning algorithm to obtain the parent element XPATH that matches the characteristic value of the parent element, and to obtain the child element XPATH that matches the characteristic value of the child element and the characteristic value of the target element; splicing the child element XPATH to the right side of the parent element XPATH to obtain the target element XPATH; based on the characteristic value of the target element XPATH and the target action, executing the corresponding interactive action. The present invention can not only reduce a large amount of manpower input, but also solve the redundant manual testing workload, and greatly reduce the maintenance cost.

The present application provides a method for extracting page data and a method for automated page testing. The method for extracting page data is used to extract the tree-structured data corresponding to the tree-like content displayed on a web page, and includes: obtaining the relative xpath of the root node in the tree-structured data in the page to be tested; using the relative xpath of the root node as the current relative xpath, and using a preset recursive call method to obtain a list of relative xpaths, where the list of relative xpaths includes the relative xpath of each node arranged in depth-first order in the tree-structured data; converting the list of relative xpaths into a dictionary. The page extraction method can automatically extract the tree-structured data corresponding to the tree-like content and return it in the form of a dictionary, which is convenient for subsequent automated page testing.

The application discloses a data burying point test method and device based on natural language intelligent identification control, and comprises the following steps: identifying a target control based on a natural language script, the target control comprising XPath and a first target parameter; determining whether a target element exists in a current page element structure based on the XPath, the target element comprising a second target parameter, and the target element being at least one; if the target element exists, determining whether the target control matches the target element based on the first target parameter and the second target parameter; in the case that the target control matches the target element, obtaining data burying points corresponding to the target element, and verifying the data burying points. In the above process, the target control can be identified through natural language, and it is determined whether the target element exists based on the XPath in the target control, front-end page operation is performed, and automatic verification of burying point data is performed, so that the element attribute and the decomposed page module do not need to be known in advance, and the matching efficiency is improved.

The application provides a webpage information extraction and classification method and device, and belongs to the technical field of artificial intelligence. The webpage information extraction and classification method comprises the following steps: converting the source code of a target webpage into a dom tree; processing each node of the dom tree to obtain four feature matrices, i.e., a text feature matrix, an Xpath feature matrix, a layout feature matrix and a visual feature matrix; inputting the four feature matrices into an encoding network respectively to obtain four representation vectors; performing feature fusion on the four representation vectors to obtain fused features; inputting the fused features into a classification network to obtain and store the classification result of an information unit of the target webpage, wherein the classification result comprises at least one of the following: a table, a form to be filled, a text unit that needs to be linked to a next webpage for display, a navigation bar or a display bar, pure text, an advertisement and useless information. The technical scheme of the application can improve the universality of the webpage information extraction and classification scheme.

The present invention discloses a method, device, equipment and medium for extracting vertical website information based on a large model. According to the technical solution provided by the present invention, a large language model is used to extract the first attribute text information corresponding to the target attribute from the seed web page selected from the vertical field website; the correct node is screened from the node corresponding to the information, and the absolute path expression of the XPath of the correct node is determined; the anchor node is determined from the DOM tree based on the absolute path expression, and the XPath final expression is constructed based on the relative position of the correct node and the anchor node; the second attribute text information corresponding to the target attribute is extracted from the vertical field website using the XPath final expression. Through the present invention, the correct node and the anchor node are determined from the seed web page in the vertical field website, and the XPath final expression derived from the relative position of the two is used to extract the target information from the website, thereby achieving a lower cost and more accurate extraction of the target information without the need for model training.

The invention belongs to the technical field of table data processing, and discloses a method for extracting and merging EXCEL table data in XFA based on a JAVA language, and the method for extracting and merging table data comprises the following steps: step 1, analyzing an XFA form; step 2, analyzing the XFAXML data; step 3, constructing an EXCEL table template; and step 4, filling the data into Exce l. According to the method, the compatibility of various PDF forms is realized by combining libraries such as Apache PDFBox and the like, XFA data are extracted from the libraries, the XFAXML data are accurately and efficiently processed by utilizing a JavaDOM analyzer and XPath, complex data models and relation requirements are met, styles, formats and placeholders can be flexibly adjusted by customizing an Exce l template, a modular processing mode is adopted for a plurality of XFA data sources, and the data processing efficiency is greatly improved. According to the method and the system, the data are integrated into different areas of the Exce l workbook, resource management and exception handling are emphasized, the program efficiency and the system stability are improved, and the method and the system have excellent expansibility, can quickly adapt to new scenes and requirements, and realize quick response to new challenges.

Embodiments of the present specification relate to the technical field of text processing, and provide a text blocking method and device based on HTML node path analysis, comprising: performing initial blocking on the HTML document to obtain an initial HTML document blocking result, and recording an XPath path expression corresponding to each piece of text in the target HTML document and an initial HTML document block to which the text belongs; performing preprocessing on each initial HTML document block to obtain a plurality of initial pure text document blocks; performing merging or segmentation operations on the initial pure text document blocks to obtain a plurality of final pure text document blocks; and blocking the target HTML document according to the XPath path expression corresponding to each piece of text in the final pure text document blocks and the initial HTML document block to which the text belongs, to obtain a final HTML document blocking result. Through the embodiments of the present specification, the accuracy of HTML text blocking can be improved.

Described are methods and corresponding systems for generating and using selectors during web development. In some implementations, one or more natural language statements are obtained as input to a software application, for example, a web browser extension. The one or more input statements are analyzed, using natural language processing, to identify a first web element of a webpage and an action to be performed with respect to the first web element. A selector is then generated based on one or more attributes of the first web element. The selector operates as an address of the first web element and can, for example, be an XPath or CSS selector. To provide a user with access to the selector, the selector can be displayed on a user interface and / or saved to an output file. In some instances, the selector is generated as part of program code executable to perform the action.

The invention provides a process aided design method based on matching degree calculation and parameter pushing, which comprises the following steps of: firstly, constructing different process file label systems according to different product category libraries and process method libraries, and labeling each process file by using an Xpath language and a regular matching method; secondly, acquiring a requirement input by a user, comparing a process file matching degree calculation code with a process file in a corresponding process file label system, and outputting a matching degree; then, sorting the process files from high to low according to the matching degrees, and displaying a plurality of process files with the highest matching degree to a user; and finally, based on the technological parameter recommendation codes of the technological parameter library, matching technological parameter items and parameter values in the existing technological parameter library, and displaying the technological parameter items and parameter values to a user for reference. According to the method, the user can be helped to quickly find the process file which is most matched with the demand, the user is helped to carry out product process design through historical knowledge pushing and parameter matching, and the design efficiency and quality are improved.

The present disclosure provides a method and device for generating an automatic test script and a storage medium, including: obtaining an initial automatic test script and parsing the initial automatic test script to extract an initial XPath path; obtaining content of a webpage to be tested, parsing the content of the webpage to generate a DOM tree of the webpage to be tested; determining a corresponding test script data table based on the initial XPath path; establishing a webpage element matrix model based on the DOM tree; optimizing the initial XPath path based on the test script data table and the webpage element matrix model to obtain a target XPath path, and generating a target UI automatic test script based on the target XPath path. Thus, the present disclosure can automatically adjust the initial XPath path to obtain the target XPath path through the test script data table and the webpage element matrix model, without manual adjustment, thereby improving the generation efficiency and accuracy of the test script, and further improving the efficiency and accuracy of UI testing.

The present application relates to the technical field of software test automation, and particularly relates to a method and system for inferring the position of a target UI element based on UI operation trajectories, comprising: when an XPath positioning operation performed by a test case on a target UI element in a page under test fails, constructing a first operation trajectory according to a preceding UI operation that has been successfully performed, matching and determining a candidate set of position information of the target UI element in combination with all historical successful operation trajectories, extracting interactive UI elements and sorting them according to preset conditions, and determining the target UI element and its final position information. When the XPath positioning fails, the present application can automatically infer the position of the target element according to the preceding operation trajectory and the historical operation trajectory to restore the test execution, significantly improving the stability and continuity of the automated test, reducing the dependence on manual maintenance, and simultaneously having good self-adaptive ability to UI interface changes.

The invention discloses an XPath path positioning-based HTML (Hypertext Markup Language) document sentence-level intelligent labeling method and system, relates to the technical field of computer document processing and data labeling, constructs a'purification-sandbox-event interception 'three-layer security architecture, and provides a reliable guarantee for processing an untrusted HTML document through DOMPurity purification, iframe sandbox isolation and event interception mechanisms; sentence boundaries in the HTML document are recognized, and the labeling granularity is improved from a traditional paragraph level to a sentence level; the XPath path technology is used for HTML document sentence-level labeling and positioning, and the positioning precision and stability of labeling are improved by generating an accurate and flexible positioning expression; and a joint index mechanism of the XPath path and the text abstract is designed, so that the technical problem that the annotation is easy to lose after the document structure is changed is solved, and the annotation recovery success rate is improved. According to the method and the system, sentence-level refined and secure intelligent labeling on the HTML document is realized.

The application discloses an intelligent element positioning method and system based on AI and a dynamic feature library, which comprises: abnormality detection and abnormal data capture, element positioning operation is performed through an automatic script, and a page DOM tree structure snapshot is recorded when positioning fails; multi-modal feature extraction, DOM tree analysis, extraction of XPath / CSS path and semantic attributes of a target element; dynamic feature library retrieval and matching, calculation of DOM structure similarity, and use of high similarity rules as a correction basis; AI intelligent rule generation, generation of candidate positioning rules through a classification model; script correction and real-time feedback, replacement of invalid positioning statements and updating of the dynamic feature library; and generation of a structured report, recording of abnormal data. The application realizes intelligent correction of element positioning in an automatic test process through the combination of AI and a dynamic feature library, and improves the stability and efficiency of automatic testing.

This invention provides a fine-grained automatic identification method for IoT devices based on firmware simulation, relating to the field of IoT technology. The method includes: automatically collecting IoT device tags from aggregation websites using web crawling technology and constructing an IoT device tag library; automatically collecting IoT device firmware using XPath expressions combined with an ASCII-based firmware search algorithm; simulating the obtained device firmware, accessing the simulated device IP address and extracting the device fingerprint; automatically generating and matching regular expressions for positive samples based on the device fingerprint; using a binary tree-based model regular expression matching strategy for efficient and accurate model identification; extracting features from web files in the IoT device firmware using BinWalk; training the extracted features using a decision tree model; designing a tree-based rule-based scanning and identification strategy; converting the decision tree model into a rule tree; and identifying the version number of the IoT device, thereby improving the accuracy of identification.

A method for creating a standardized XML format including the steps of (1) defining an event element, (2) creating a template file having the event element; (3) identifying a message on a shared bus; (4) determining a bus message type of the message; and (5) creating an output XML file based on the template file when the value of the bus message type is equal to the value of the event user identification attribute.

The application relates to the development of auxiliary technology, and discloses a template-based WEB page element positioning method, device, equipment and medium. The method comprises the following steps: using a marking tool to select a region of interest in a screenshot of a WEB page currently displayed by a browser, and generating a template definition file of the region of interest; obtaining a target screenshot of a target WEB page in the browser, and converting corresponding elements in the target screenshot into a conversion matrix list by using elements with an anchor type identified by a type field in the template definition file; calculating the positions of elements with the same element name and a value type identified by the type field in the target screenshot according to the conversion matrix list, obtaining a text box of the value type element corresponding to the positions, and obtaining an xpath of the value type element; and outputting corresponding elements in the target page screenshot according to the xpath of the value type element by using an RPA system. The application can improve the accuracy and efficiency of information acquisition in a WEB page of a hospital system.