24 results about "Dynamic web page" patented technology

The invention discloses an intelligent crawler generation method and system based on a large language model and an MCP protocol, belongs to the technical field of network data collection, and solves the problem that the capability of LLM in dynamic webpage analysis and anti-crawling strategy generation links cannot be fully exerted due to the fact that LLM and browser interaction protocols cannot be effectively integrated in the prior art. The method comprises the steps of analyzing an acquisition demand based on a large language model and generating a standardized demand description document, realizing interaction between the large language model and a browser based on an MCP protocol, analyzing a page complete DOM tree structure through a crawler script generation system, and performing quality verification and intelligent repair on a generated crawler script. According to the method, the complete DOM tree and the dynamic data rendered by the browser are obtained through the MCP, and the large language model can be called to automatically analyze the element positioning strategy, so that the collection script is adaptively generated, and high efficiency, intelligence and automation of webpage data collection are ensured.

The invention discloses a dynamic webpage content complete collection system and method based on a browser rendering engine. A CDP controller main module calls a command to start a headless browser process, and a network monitoring module registers a Network. Response Received event monitor; a DOM (Document Object Model) monitoring module starts a Mutation Observer to monitor the change of a DOM (Document Object Model) tree; the interactive simulation module preloads a mouse click and scroll event instruction set; capturing JSON / XML data returned by an interface in real time by using a network monitoring module, intercepting API response data, generating a DOM snapshot by using a DOM monitoring module, and extracting key structure changes; the DOM monitoring module provides a complete rendering HTML, the network monitoring module provides request metadata, and the interactive simulation module provides an operation time sequence log and packages generated complete webpage data into a WARC file. According to the method, document collection is upgraded to application-level interaction, and a technical implementation path is provided for collection scenes of dynamic data-intensive websites (such as financial public opinion monitoring and e-commerce price tracking) in which Internet resources are stored for a long time.

The embodiment of the invention relates to the technical field of information, and discloses a webpage dynamic effect generation and rendering method, a webpage dynamic effect rendering method, equipment, a medium and a product, the method comprises the following steps: monitoring a starting state of a host webpage through a plug-in background service, injecting a dynamic effect execution script into an operating environment of the host webpage, and establishing a two-way communication channel; receiving a dynamic effect configuration parameter for the target element, and binding the dynamic effect configuration parameter with the unique feature identifier to generate a global index ID; in a dynamic effect rendering stage, acquiring dynamic effect configuration data according to the global index ID, and performing feature matching to position a target element; the dynamic effect parameter is applied to the positioned target element, and the rendering logic is executed in the host webpage through the dynamic effect execution script, so that the dynamic effect can still be accurately and stably mounted in the complex and changeable dynamic webpage environment, and the dynamic effect can be accurately and stably mounted on the premise of meeting the strict security policy of the browser. And cloud issuing and hot updating of the dynamic effect logic code are realized.

The invention provides a method and device for acquiring OG data of multiple social media platforms through links, and belongs to the technical field of data acquisition and processing. The method comprises the following steps: acquiring URL links from a plurality of social media platforms and common webpages as source data, wherein the source data correspond to webpage OG data lt; carrying out metagt; the label form is embedded into the lt of the HTML; carrying out headt; a label; performing validity check and standardization on the URL link, capturing webpage content by using an asynchronous HTTP (Hyper Text Transport Protocol) request library, and loading a complete HTML (Hyper Text Markup Language) on a dynamic webpage through a headless browser; the HTML positioning result is analyzed; carrying out metagt; tag: extracting an OG standard field and a platform extension field, and deducing a missing field from other HTML tags; mapping each platform OG field into a unified standard field; and outputting the OG data containing fields such as title and the like through the standardized API interface. According to the method, the multi-platform OG data acquisition efficiency, accuracy and safety are improved, good expansibility is achieved, and the cross-platform data integration requirement is met.

The application discloses a data crawling analysis method and device based on an industrial internet, and a medium, and belongs to the technical field of industrial internet data processing, and is used for solving the technical problems that the industrial internet data crawling in the prior art cannot be compatible with multiple types of web pages and dynamic loading technology, lacks customized rule configuration, has weak anti-crawling capability, and has low data structuring degree. The method comprises the following steps: collecting user demand data of a user; performing customized configuration on the initial crawling rule under the relevant rule adjustment to obtain a customized rule; performing crawling processing on a target website under relevant dynamic web pages and static web pages, and based on an anti-crawling mechanism, monitoring and controlling corresponding crawling actions to obtain target webpage data crawled; performing data structure analysis processing on the target webpage data to obtain a data structure format; performing distributed storage on the data structure format to obtain data storage result information; and feeding back and adjusting the customized rule.

The application relates to the technical field of medical data processing, and discloses a knee joint three-dimensional movement analysis platform for clinical auxiliary diagnosis, which comprises the following steps: a data processing module adopts Magic software to collect knee joint three-dimensional movement original data, carries out coordinate correction and model processing, and generates a model group. A model analysis module imports the model group into a C3D clinical window, realizes real-time visualization of a three-dimensional movement track, calculates biomechanical parameters, and evaluates clinical pathology correlation. A man-machine interaction control module provides customized interaction logic and a graphical interface, supports parameter input, analysis process control, real-time monitoring, and automatic generation of a diagnosis report. A cloud publishing module converts the diagnosis report and the interface into a PHP dynamic webpage, deploys the webpage through HTTP, supports SSL encryption, multi-user concurrent access, and cross-platform remote calling. The application supports real-time visualization of a knee joint three-dimensional movement track, and improves data reliability.

A system and method provide a dynamic interface that displays multiple products or product options and accepts, from a user, one or more selections from among the displayed products or options. The dynamic interface rearranges the display and displays indications of the selections. The dynamic display may also include additional options, information, or data input fields along with each displayed indication of a selection.

Embodiments of the present application provide a webpage tampering monitoring method, device, equipment and medium. The method comprises: obtaining a response body returned by a Web service end to a browser and a webpage request corresponding to the response body; classifying the webpage request to determine the request category of the webpage request; for a first webpage request with an asynchronous AJAX request category, identifying a field data tampering behavior based on the response body corresponding to the first webpage request to obtain a first webpage tampering result; and for a second webpage request with a synchronous HTTP request category, calling a deep learning model to monitor tampering of different types of resources in the response body corresponding to the second webpage request to obtain a second webpage tampering result. Through the method of the embodiments of the present application, the tampering behavior monitoring scene of static and dynamic webpages can be compatible, and the flexibility and monitoring efficiency of webpage tampering monitoring can be improved.

The invention provides a transcoding method and device, equipment, a storage medium and a program product, relates to the technical field of software development, and particularly can be applied to front-end software development in the field of financial science and technology. The method comprises the following steps of: converting a dynamic webpage technical standard source code into JSON (JavaScript Object Notation) data; traversing a data structure of the JSON data to obtain JSON data node information; and mapping the JSON data node to a technical framework of the target component based on the JSON data node information, and generating a target component code.

Embodiments of the present application disclose a webpage identification processing method and device, computer equipment and a readable storage medium, comprising: obtaining a dynamic resource request of a webpage to be identified, the dynamic resource request being used to request a server to obtain real-time updated dynamic webpage resources and render interactive webpage content corresponding to the webpage to be identified; obtaining a static resource request of the webpage to be identified, the static resource request being used to request a server to obtain static webpage resources and render initial webpage content of the webpage to be identified; generating a set of resource requests to be identified based on the dynamic resource request and the static resource request, and obtaining resource request texts based on request fields included in each resource request in the set of resource requests to be identified; mapping the resource request texts to an identification feature sequence of the webpage to be identified, and generating a webpage identification of the webpage to be identified based on the identification feature sequence. By using the present application, the accuracy of obtaining the webpage identification can be improved, and the applicability is high.

The application relates to the technical field of dynamic webpage optimization, in particular to a dynamic webpage optimization system and method based on AJAX intelligent interaction; the system comprises a webpage loading speed optimization module, an interactive experience enhancement module, a data transmission optimization module and a dynamic webpage optimization end, the webpage loading speed optimization module and the interactive experience enhancement module provide a smooth basic environment for interactive operation, reduce the anxiety of users during waiting, the data transmission optimization module and the individualized service module realize light-weight and efficient data transmission, and the prerequisite for real-time acquisition of user behavior data and generation of individualized content, a compatibility guarantee module is used for pre-considering the differences between different terminals and browsers for the optimization strategies of the modules, avoiding optimization failure caused by compatibility problems, finally, an optimization closed loop is formed through data feedback between the modules, and the continuous improvement of dynamic webpage performance and experience is promoted.

In one embodiment, an agent executed by a device intercepts webpage code for a website sent from an application server to a client of the website. The agent identifies a portion of the webpage code as being used for webpage analytics. The agent forms modified webpage code by disabling the portion of the webpage code, based on one or more performance metrics associated with the website. The agent sends the modified webpage code to the client of the website.

The invention discloses a path positioning method and device based on a dictionary tree structure and weight learning and a medium, and relates to the technical field of computers, and the method comprises the following steps: obtaining document object model elements; evaluating the weight score of the node of the document object model element, and determining a target node meeting a preset importance condition based on the weight score of the node of the document object model element; and extracting feature information of the target node to generate a comprehensive feature code, performing similar feature matching with a preset dictionary tree based on the comprehensive feature code of the target node, and generating a recommended target path based on the structure tree with successful similar feature matching under the condition that the comprehensive feature code of the target node is successfully matched with the preset dictionary tree. Therefore, the problems that traditional element positioning depends on paths such as an array corner mark and the like, the technology coupling degree is high, dynamically generated class names in a dynamic webpage generate feature noise interference and affect the positioning accuracy, and a positioner in an automatic test script is large in maintenance workload and high in maintenance cost are solved.

A system and method provide a dynamic interface that displays multiple products or product options and accepts, from a user, one or more selections from among the displayed products or options. The dynamic interface rearranges the display and displays indications of the selections. The dynamic display may also include additional options, information, or data input fields along with each displayed indication of a selection.

The invention relates to the technical field of 5G new calls, in particular to a video business card generation method and device, a video business card playing method and device, equipment, a medium and a product, and the generation method comprises the steps: receiving a business card making request sent by a user; according to a specified screenshot frequency, performing screenshot on a dynamic webpage template in the business card making request to obtain a plurality of pictures; generating an intermediate frame for any two adjacent pictures, and generating a dynamic video based on the plurality of pictures and the intermediate frame; and generating a video business card of the user based on the material video and the dynamic video. Through the dynamic webpage, various video templates with rich contents can be provided for the user, and the webpage template selected by the user and the personal material video are synthesized to generate the dynamic video business card, so that the vividness of the video business card is improved. The dynamic webpage template is screenshot through the specified screenshot frequency, webpage rendering can be reduced, and waste of computing resources is avoided. By generating the middle frame, the frame rate and the fluency of the video business card can be improved.

The invention is suitable for the technical field of data statistics management, and provides a custom table management method and system based on a dynamic webpage technology, and the method comprises the following steps: designing three tables, namely a'diytable ', a'diycolumn' and a'diyvalue ', in a server-side database management system by adopting a B / S (Browser / Server) mode; independent table creation and maintenance, data management and cross-table retrieval of a user are realized by developing a management webpage; according to the data table management method in the B / S mode, a user can achieve the function similar to an EXCEL spreadsheet without installing software or plug-ins, meanwhile, the use threshold is lowered, a large amount of installation and deployment work is reduced, data information is flattened and associated in a data design mode, data information cross-table retrieval is achieved, and the user experience is improved. And efficient information utilization is improved.

The application discloses a path positioning method and device based on a dictionary tree structure and weight learning and a medium, relates to the technical field of computers, and comprises the following steps: acquiring a document object model element; evaluating a weight score of a node of the document object model element, determining a target node satisfying a preset importance condition based on the weight score of the node of the document object model element; extracting feature information of the target node to generate comprehensive feature encoding, performing similar feature matching based on the comprehensive feature encoding of the target node and a preset dictionary tree, and generating a recommended target path based on a structure tree of which the similar feature matching is successful in the case that the comprehensive feature encoding of the target node matches the preset dictionary tree successfully. Therefore, the problems that a traditional element positioning depends on an array index path, the technical coupling degree is high, feature noise interference is generated in a dynamically generated class name in a dynamic web page, the positioning accuracy is affected, the maintenance workload of a locator in an automatic test script is large, and the maintenance cost is high are solved.

The invention belongs to the field of data collection, and relates to a thermal power plant webpage data collection method and system based on an image recognition technology, and the system obtains webpage display content in real time through a webpage content capturing module, and achieves dynamic webpage data collection; carrying out preprocessing operation on the captured webpage image through an image preprocessing module; text information is extracted through a text recognition module, and accurate recognition of multi-language texts is supported; performing structured analysis on the recognized text data through a format analysis module; multiple verification is performed on the identified and extracted data through a data verification module; through the data output module, the verified data is output in a standardized format, and the data is transmitted to multiple devices through a Modbus RTU protocol, so that data synchronization and automatic fault switching are supported, and the real-time performance and reliability of data transmission are ensured. Based on the image recognition technology, the webpage data of the thermal power plant can be efficiently and accurately collected in real time, and the precision and reliability of data collection are improved.

The invention relates to the technical field of medical data processing, and discloses a knee joint three-dimensional movement analysis platform for clinical auxiliary diagnosis, which comprises a data processing module for acquiring knee joint three-dimensional movement original data by adopting Magic software, performing coordinate correction and model processing, and generating a model group. And the model analysis module imports the model group into a C3D clinical window to realize real-time visualization of a three-dimensional moving track, biomechanical parameter calculation and clinical pathology correlation evaluation. The man-machine interaction control module provides customized interaction logic and a graphical interface, and supports parameter input, analysis process control, real-time monitoring and automatic generation of a diagnosis report. The cloud publishing module converts a diagnosis report and an interface into a PHP dynamic webpage, and supports SSL encryption, multi-user concurrent access and cross-platform remote calling through HTTP deployment. Real-time visualization of the knee joint three-dimensional movement track is supported, and the data reliability is improved.

The application discloses a method and system for generating intelligent crawlers based on a large language model and an MCP protocol, and belongs to the technical field of network data collection. The method solves the problem that the prior art cannot effectively integrate an LLM and a browser interaction protocol, resulting in the inability to fully exert the capability of the LLM in the dynamic webpage analysis and anti-crawling strategy generation links. The method comprises the following steps: analyzing the collection requirement based on a large language model and generating a standardized requirement description document; realizing the interaction between the large language model and the browser based on an MCP protocol; and performing complete DOM tree structure analysis and processing on a page through a crawler script generation system, and performing quality checking and intelligent repairing on the generated crawler script. In the application, the complete DOM tree and dynamic data after browser rendering are obtained through the MCP protocol, and the large language model can be called to automatically analyze element positioning strategies, so that the collection script can be adaptively generated, and the efficiency, intelligence and automation of webpage data collection are ensured.

The invention discloses an energy management method based on light-storage integration, and relates to the technical field of energy management, and the method comprises the steps: enabling an energy display unit to sequentially load a front-end file and a rear-end file of a corresponding dynamic page in a process that a manager carries out an inspection task on a target data source; if the memory does not exist when the corresponding recorded data is extracted in the loading process, storing the loaded data extracted from the data storage library into the memory, and setting the corresponding expiration duration, so that the storage resources of the memory are more reasonably utilized; after a fixed number of inspection monitoring data of inspection tasks are stored, the inspection monitoring data are analyzed to determine expiration durations and serial numbers of a plurality of monitoring items based on a plurality of energy parameters, and in this way, part of loading data which still need to be frequently called are reserved in a memory as much as possible. The loading data amount extracted from the memory in the dynamic webpage loading process is more, and the loading rate of the dynamic webpage is further optimized.

The invention relates to the technical field of dynamic webpage optimization, in particular to a dynamic webpage optimization system and method based on AJAX intelligent interaction. Comprising a page loading speed optimization module, an interaction experience enhancement module, a data transmission optimization module and a dynamic webpage optimization end, a smooth basic environment is provided for interaction operation through the page loading speed optimization module and the interaction experience enhancement module, and the anxiety feeling of a user during waiting is reduced; on the premise that the data transmission optimization module and the personalized service module achieve lightweight and efficient data transmission, user behavior data are obtained in real time and personalized content is generated, the compatibility guarantee module needs to consider differences between different terminals and browsers in advance for optimization strategies of all the modules, optimization failure caused by the compatibility problem is avoided, and the user experience is improved. Finally, an optimized closed loop is formed through data feedback among the modules, and continuous improvement of dynamic webpage performance and experience is promoted.

The application discloses an energy management method based on light storage integration, and relates to the technical field of energy management.The front-end file and the back-end file of the corresponding dynamic page are loaded by the energy display unit in sequence during the inspection task performed by the management personnel on the target data source, and the loaded data extracted from the data storage is stored in the memory and the corresponding expiration duration is set when the corresponding recorded data is not in the memory during the loading process, so that the storage resources of the memory are more reasonably utilized;after the inspection monitoring data of a fixed number of inspection tasks are stored, the inspection monitoring data are analyzed to determine the expiration duration and the serial number of a plurality of energy parameters of a plurality of monitoring items, and in this way, the loaded data that still needs to be frequently called is retained in the memory as much as possible, so that the amount of loaded data extracted from the memory during the dynamic web page loading process is more, and the loading rate of the dynamic web page is further optimized.

This invention discloses a multi-agent intent-hiding web crawler method based on a large language model, belonging to the field of intelligent web page data collection and privacy protection technology. This method constructs a collaborative system driven by a large language model, consisting of a task planning agent, a sub-task execution agent, and a feedback optimization agent. It decomposes the user's high-level collection intent into a low-sensitivity sub-task chain, and uses a feedback optimization mechanism to achieve scheduling, execution, and dynamic adjustment. It automatically completes web page access, content extraction, and anomaly handling, and outputs the results in a structured manner. This invention, employing the aforementioned multi-agent intent-hiding web crawler method based on a large language model, significantly reduces the risk of crawler intent exposure, improves the success rate and adaptability of collection in high-anti-crawling and dynamic web page environments, reduces manual rule configuration, and is highly versatile and stable, suitable for various public web page data collection and open-source intelligence acquisition scenarios.