20 results about "XPath" patented technology

The invention belongs to the technical field of computers, and discloses a news detail page XPath automatic extraction method and system based on a large model, and the method comprises the steps: determining a large model base through multi-aspect evaluation; the method comprises the following steps: preprocessing an HTML page, designing a structured prompt template and constructing a thinking chain CoT data set; utilizing a Lora technology fine tuning model, and adopting a smooth loss function and a dual reward mechanism of fusion format and content evaluation to optimize; and performing format calibration on the XPath and the JSON output by the model, and extracting and verifying the validity of the URL of the detail page by using the calibrated XPath. Compared with a traditional template-based information extraction method, the method does not depend on the stability of a webpage structure, has higher generalization ability and fault tolerance, remarkably improves the information extraction precision, enhances the complex webpage adaptability, improves the overall robustness and universality of a system, and is suitable for large-scale popularization and application. And a stable extraction effect can still be kept in news websites with frequent structure change.

The invention discloses a website data analysis method and device based on a large model technology, and belongs to the field of fusion of web crawlers and artificial intelligence. According to the method, a local knowledge base drives a large model to generate a precise XPath rule, and the precise XPath rule is packaged into a decoupling plug-in and integrated into an existing crawler framework; a dynamic feedback optimization mechanism is innovatively designed, rule validity is monitored in real time by using a composite verifier, and XPath reconstruction and knowledge base updating are automatically triggered. According to the method, the high concurrency performance of a traditional crawler is reserved, the rule generation efficiency and the system robustness are remarkably improved, the manual maintenance cost is reduced, and the method is suitable for a website data collection scene with a complex structure or frequent updating.

The application discloses a data burying point test method and device based on natural language intelligent identification control, and comprises the following steps: identifying a target control based on a natural language script, the target control comprising XPath and a first target parameter; determining whether a target element exists in a current page element structure based on the XPath, the target element comprising a second target parameter, and the target element being at least one; if the target element exists, determining whether the target control matches the target element based on the first target parameter and the second target parameter; in the case that the target control matches the target element, obtaining data burying points corresponding to the target element, and verifying the data burying points. In the above process, the target control can be identified through natural language, and it is determined whether the target element exists based on the XPath in the target control, front-end page operation is performed, and automatic verification of burying point data is performed, so that the element attribute and the decomposed page module do not need to be known in advance, and the matching efficiency is improved.

The application provides a webpage information extraction and classification method and device, and belongs to the technical field of artificial intelligence. The webpage information extraction and classification method comprises the following steps: converting the source code of a target webpage into a dom tree; processing each node of the dom tree to obtain four feature matrices, i.e., a text feature matrix, an Xpath feature matrix, a layout feature matrix and a visual feature matrix; inputting the four feature matrices into an encoding network respectively to obtain four representation vectors; performing feature fusion on the four representation vectors to obtain fused features; inputting the fused features into a classification network to obtain and store the classification result of an information unit of the target webpage, wherein the classification result comprises at least one of the following: a table, a form to be filled, a text unit that needs to be linked to a next webpage for display, a navigation bar or a display bar, pure text, an advertisement and useless information. The technical scheme of the application can improve the universality of the webpage information extraction and classification scheme.

The invention belongs to the technical field of table data processing, and discloses a method for extracting and merging EXCEL table data in XFA based on a JAVA language, and the method for extracting and merging table data comprises the following steps: step 1, analyzing an XFA form; step 2, analyzing the XFAXML data; step 3, constructing an EXCEL table template; and step 4, filling the data into Exce l. According to the method, the compatibility of various PDF forms is realized by combining libraries such as Apache PDFBox and the like, XFA data are extracted from the libraries, the XFAXML data are accurately and efficiently processed by utilizing a JavaDOM analyzer and XPath, complex data models and relation requirements are met, styles, formats and placeholders can be flexibly adjusted by customizing an Exce l template, a modular processing mode is adopted for a plurality of XFA data sources, and the data processing efficiency is greatly improved. According to the method and the system, the data are integrated into different areas of the Exce l workbook, resource management and exception handling are emphasized, the program efficiency and the system stability are improved, and the method and the system have excellent expansibility, can quickly adapt to new scenes and requirements, and realize quick response to new challenges.

Embodiments of the present specification relate to the technical field of text processing, and provide a text blocking method and device based on HTML node path analysis, comprising: performing initial blocking on the HTML document to obtain an initial HTML document blocking result, and recording an XPath path expression corresponding to each piece of text in the target HTML document and an initial HTML document block to which the text belongs; performing preprocessing on each initial HTML document block to obtain a plurality of initial pure text document blocks; performing merging or segmentation operations on the initial pure text document blocks to obtain a plurality of final pure text document blocks; and blocking the target HTML document according to the XPath path expression corresponding to each piece of text in the final pure text document blocks and the initial HTML document block to which the text belongs, to obtain a final HTML document blocking result. Through the embodiments of the present specification, the accuracy of HTML text blocking can be improved.

The present disclosure provides a method and device for generating an automatic test script and a storage medium, including: obtaining an initial automatic test script and parsing the initial automatic test script to extract an initial XPath path; obtaining content of a webpage to be tested, parsing the content of the webpage to generate a DOM tree of the webpage to be tested; determining a corresponding test script data table based on the initial XPath path; establishing a webpage element matrix model based on the DOM tree; optimizing the initial XPath path based on the test script data table and the webpage element matrix model to obtain a target XPath path, and generating a target UI automatic test script based on the target XPath path. Thus, the present disclosure can automatically adjust the initial XPath path to obtain the target XPath path through the test script data table and the webpage element matrix model, without manual adjustment, thereby improving the generation efficiency and accuracy of the test script, and further improving the efficiency and accuracy of UI testing.

The present application relates to the technical field of software test automation, and particularly relates to a method and system for inferring the position of a target UI element based on UI operation trajectories, comprising: when an XPath positioning operation performed by a test case on a target UI element in a page under test fails, constructing a first operation trajectory according to a preceding UI operation that has been successfully performed, matching and determining a candidate set of position information of the target UI element in combination with all historical successful operation trajectories, extracting interactive UI elements and sorting them according to preset conditions, and determining the target UI element and its final position information. When the XPath positioning fails, the present application can automatically infer the position of the target element according to the preceding operation trajectory and the historical operation trajectory to restore the test execution, significantly improving the stability and continuity of the automated test, reducing the dependence on manual maintenance, and simultaneously having good self-adaptive ability to UI interface changes.

The invention discloses an XPath path positioning-based HTML (Hypertext Markup Language) document sentence-level intelligent labeling method and system, relates to the technical field of computer document processing and data labeling, constructs a'purification-sandbox-event interception 'three-layer security architecture, and provides a reliable guarantee for processing an untrusted HTML document through DOMPurity purification, iframe sandbox isolation and event interception mechanisms; sentence boundaries in the HTML document are recognized, and the labeling granularity is improved from a traditional paragraph level to a sentence level; the XPath path technology is used for HTML document sentence-level labeling and positioning, and the positioning precision and stability of labeling are improved by generating an accurate and flexible positioning expression; and a joint index mechanism of the XPath path and the text abstract is designed, so that the technical problem that the annotation is easy to lose after the document structure is changed is solved, and the annotation recovery success rate is improved. According to the method and the system, sentence-level refined and secure intelligent labeling on the HTML document is realized.

The application relates to the development of auxiliary technology, and discloses a template-based WEB page element positioning method, device, equipment and medium. The method comprises the following steps: using a marking tool to select a region of interest in a screenshot of a WEB page currently displayed by a browser, and generating a template definition file of the region of interest; obtaining a target screenshot of a target WEB page in the browser, and converting corresponding elements in the target screenshot into a conversion matrix list by using elements with an anchor type identified by a type field in the template definition file; calculating the positions of elements with the same element name and a value type identified by the type field in the target screenshot according to the conversion matrix list, obtaining a text box of the value type element corresponding to the positions, and obtaining an xpath of the value type element; and outputting corresponding elements in the target page screenshot according to the xpath of the value type element by using an RPA system. The application can improve the accuracy and efficiency of information acquisition in a WEB page of a hospital system.

The application provides a method, device and equipment for generating a PDF based on a webpage, and a storage medium. The method comprises the following steps: obtaining a webpage access path and an Xpath path of core content of a webpage to be accessed; sending an access request to the webpage based on the webpage access path, and obtaining feedback webpage data; determining a webpage element node tree of the webpage data; determining non-core data that needs to be deleted in the webpage data based on content in the Xpath path and the webpage element node tree, wherein the non-core data is data other than core data and display-related data in the webpage data; deleting the non-core data in the webpage; and generating a corresponding PDF file based on the core data displayed in the webpage data. The method for generating a PDF based on a webpage can directly convert webpage content into a PDF file, and the layout is normal, and the file content can be enlarged without distortion.

This invention discloses a method, system, computer, and storage medium for multimodal webpage data structured extraction based on visual features and a large model. The method involves acquiring webpage screenshots and HTML source code via a browser; normalizing, enhancing, and segmenting the screenshots to output preprocessed screenshots and coordinates of the core content area; cleaning the HTML, adding XPath and hierarchical structured text; inputting both into a multimodal large model to generate an initial XPath; performing bimodal validation of the initial XPath using both code and visual rules; if either fails, retrying based on the same preprocessed data until the limit is reached or success is achieved; periodic monitoring is set up, re-collecting and preprocessing data, comparing visual and code features with historical preprocessed data corresponding to the previous valid XPath; if any feature changes, repeating the aforementioned steps to generate a new XPath. This invention enables automatic XPath generation and adaptive updates, reducing maintenance costs.

The application belongs to the technical field of network information processing, and specifically provides a kind of html document attribute information disambiguation method and system, wherein the method comprises: html document is parsed into text data and table data and is stored by XPath;Attribute key and information value are obtained by using rule extraction or model extraction for line-by-line processing;Attribute key in text data and table data is disambiguated using context information respectively.The scheme converts html document into chapter and table, and then disambiguates text and table using some context information, improving the accuracy of information extraction.

The embodiment of the application belongs to the field of data processing, and relates to a webpage automation method and device, computer equipment and a storage medium.The method comprises the following steps: starting a target browser through WebDriver;starting a target browser plug-in corresponding to the target browser;obtaining page element positioning content corresponding to the target browser according to the target browser plug-in;judging whether the page element positioning content belongs to a json array and whether the number of the json array is greater than 1;if the page element positioning content belongs to the json array and the number of the json array is greater than 1, performing webpage automation operation on the page element positioning content according to the target browser plug-in;if the page element positioning content does not belong to the json array or belongs to the json array but the number of the json array is equal to 1, performing webpage automation operation on the page element positioning content according to the WebDriver.The application can not only use the complex XPath, CSSSelector matching syntax of WebDriver, but also use the anti-crawler ability of the plug-in.In addition, the browser native interface is called, and the execution efficiency is effectively improved.

An example methodology includes, by a computing device, analyzing an application to identify one or more elements in the application and, for each element of the one or more elements, an attribution of the element. The method also includes, for each element of the one or more elements, by the computing device, determining an attribute of the element which is a non-duplicate attribute, creating a first accessibility to the element by the non-duplicate attribute, creating a second accessibility to the element by XPath, and storing the first accessibility and the second accessibility created for the element within a central repository. The method may also include, by the computing device, generating a handler class for an element of the one or more elements in the application, wherein the handler class contains code for accessing the element, and providing the generated handler class to another computing device.

This application provides a document intelligent navigation method, system, electronic device, and storage medium, relating to the field of document processing technology. The method includes: acquiring a target document, wherein the target document includes one of the following document types: XML document, HTML document; extracting document structure information of the target document using XPath rules, and performing semantic parsing of the content of the target document using Natural Language Processing (NLP) to obtain a parsing result, wherein the parsing result is used to represent the relationships between different structural parts in the document structure information; and generating a target navigation directory based on the document structure information and the parsing result, wherein the target navigation directory is used for intelligent navigation. Implementing the technical solution provided in this application achieves the effect of improving the user reading experience.

The application discloses a large language model XPath generation method based on layered composite reward reinforcement learning, and specifically comprises the following steps: step 1: obtaining the HTML source code and page element information of a target webpage and performing data cleaning to obtain structured data containing a DOM hierarchical order structure and element attribute values; performing data labeling on the structured data after data cleaning to obtain a labeled data set; step 2: selecting a basic model, using the labeled data set to supervise fine-tuning of the basic model, taking the basic model after the supervised fine-tuning as a strategy model; constructing a layered composite reward function to perform reinforcement learning fine-tuning, so that the output level of the strategy model is aligned with the input DOM level, and finally obtaining a final model after two-stage fine-tuning; step 3: generating a standard XPath string and outputting structured data matched with the input DOM level to show the layer-by-layer construction logic of the standard XPath string. The application can generate stable XPath and realize completely transparent and traceable generation process.

The application provides a method and system for LLM to accurately process long class names, the method comprising: starting a browser, loading a target webpage A of a list to be identified and waiting for the webpage to be completely rendered; injecting a customized JavaScript script into the target webpage A based on a browser debugging protocol, performing layer-by-layer noise reduction processing on an original DOM, and outputting a lightweight DOM string and an original class name and compressed class name mapping table; calling a page screenshot interface through a CDP protocol to perform screenshot, and converting binary data of the screenshot into a Base64 encoded string; constructing an LLM input prompt word containing the lightweight DOM string, the Base64 encoded screenshot and a set task instruction, inputting the LLM to obtain an XPath selector containing the compressed class name; and restoring the XPath selector into an available XPath selector containing the original class name; the method can avoid character expansion caused by random long class names generated by a website, and enable the LLM to obtain relatively complete webpage structure information.

The invention provides a Word document placeholder intelligent filling method and device, a medium and a product, and relates to the technical field of office automation, the method comprises the following steps: obtaining a Word document through a predetermined API, unpacking the Word document, and analyzing the document to construct an XML tree structure; a placeholder of each XML tree structure node is obtained through a preset multi-strategy placeholder detection algorithm; calculating a multi-dimensional confidence score of the placeholder, and obtaining an effective placeholder of which the confidence score exceeds a preset confidence threshold; generating text filling content under a predetermined constraint condition through a predetermined artificial intelligence model based on the context semantics of the effective placeholders; effective placeholders are positioned in advance through Xpath, and the text filling content and the effective placeholders are replaced through a preset replacement algorithm. The method and the device solve the problems that in the prior art, the placeholder identification strategy is single, and the placeholder validity cannot be evaluated, so that placeholder filling is inaccurate.

The application provides a Word document placeholder intelligent filling method and device, medium and product, and relates to the technical field of office automation. The method comprises the following steps: obtaining a Word document through a predetermined API, unpacking the document, and parsing the document to construct an XML tree structure; obtaining placeholders of nodes of the XML tree structure through a predetermined multi-strategy placeholder detection algorithm; calculating the multidimensional confidence score of the placeholders to obtain effective placeholders with a confidence score exceeding a preset confidence threshold; generating text filling content under predetermined constraints based on the context semantics of the effective placeholders through a predetermined artificial intelligence model; and positioning the effective placeholders in advance through Xpath, and replacing the text filling content with the effective placeholders through a predetermined replacement algorithm. The application solves the problem of single placeholder recognition strategy and the inability to evaluate the effectiveness of the placeholders in the prior art, which leads to inaccurate placeholder filling.