56 results about "Headless browser" patented technology

The invention discloses an Excel report automatic conversion and rendering method, system, device and medium, and relates to the field of data processing, visualization and document generation, the method comprises the following steps: adopting an intelligent Excel analysis engine to automatically analyze Excel file structure features, and selecting a most suitable analyzer to analyze an Excel file; based on an xlsx library and a data structured conversion mechanism, performing data processing on the analyzed Excel file, and constructing a structured data model; based on a dynamic component of React, constructing different types of visual generation components according to the structured data model, and determining a layout framework; and based on a dynamic component and a structured data model of React, dynamically loading and rendering the visual content in the layout framework by adopting a headless browser technology, configuring browser parameters suitable for generating a PDF format, and displaying a PDF document according to the browser parameters. The method has the advantages of high-flexibility Excel analysis capability, strong data processing capability, rich visual expressive force, high-quality PDF rendering and efficient batch processing capability.

Disclosed is phishing classifier that classifies a URL and content page accessed via the URL as phishing or not is disclosed, with URL feature hasher that parses and hashes the URL to produce feature hashes, and headless browser to access and internally render a content page at the URL, extract HTML tokens, and capture an image of the rendering. Also disclosed are an HTML encoder, trained on HTML tokens extracted from pages at URLs, encoded, then decoded to reproduce images captured from rendering, that produces an HTML encoding of the tokens extracted, and an image embedder, pretrained on images, that produces an image embedding of the image captured. Further, phishing classifier layers, trained on the feature hashes, the HTML encoding, and the image embedding, process the URL feature hashes, HTML encoding and image embeddings to produce a likelihood score that the URL and the page accessed presents a phishing risk.

A method for automatic detection and remediation of security posture in web-applications using large vision models is fulfilled in the ongoing description by (a) initiating a headless browser as an agent to access an administrative section of a web-application, (b) enabling a pre-trained large vision model to navigate through a web user-interface of the web-application using a state transition graph, (c) determining subsequent navigation actions of the navigated web-user interface using screenshots of the navigated web-user interface with the large vision model, (d) detecting and analyzing a final state of navigation sequence of the administrative section to extract security attributes, (e) monitoring and collecting data associated with security posture of the web-application based on the security attributes, and (f) initiating automated corrective actions through a security posture remediation module upon identifying a security issue in the web-application.

The invention discloses a dynamic webpage content complete collection system and method based on a browser rendering engine. A CDP controller main module calls a command to start a headless browser process, and a network monitoring module registers a Network. Response Received event monitor; a DOM (Document Object Model) monitoring module starts a Mutation Observer to monitor the change of a DOM (Document Object Model) tree; the interactive simulation module preloads a mouse click and scroll event instruction set; capturing JSON / XML data returned by an interface in real time by using a network monitoring module, intercepting API response data, generating a DOM snapshot by using a DOM monitoring module, and extracting key structure changes; the DOM monitoring module provides a complete rendering HTML, the network monitoring module provides request metadata, and the interactive simulation module provides an operation time sequence log and packages generated complete webpage data into a WARC file. According to the method, document collection is upgraded to application-level interaction, and a technical implementation path is provided for collection scenes of dynamic data-intensive websites (such as financial public opinion monitoring and e-commerce price tracking) in which Internet resources are stored for a long time.

The invention discloses a web application file transmission and operation and maintenance auditing system and method and a medium, the system comprises a web interface transmission module and a user input and output control module, the web interface transmission module is used for using rrweb recording and playing to carry out attribute rewriting and serialization on a DOM (Document Object Model) of a headless browser web page and a state of the DOM into a specific format, and the user input and output control module is used for carrying out user input and output control on the DOM. Transmitting to a user browser, and restoring the page in the user browser; the user input and output control module comprises a mouse and keyboard input module and a file uploading and downloading module, the mouse and keyboard input module is used for increasing event monitoring for all elements through js and transmitting the event monitoring to the bastion host server side through websocket, and simulation operation is conducted in a headless browser through a CDP protocol in agent service; and the file uploading and downloading module is used for bridging file read-write to an http request sent by a user browser through a user-defined file system based on the agent module. According to the invention, only the web page content is transmitted, so that the user cannot access the file system of the server through the browser, and the safety performance is improved.

The invention provides a method and device for acquiring OG data of multiple social media platforms through links, and belongs to the technical field of data acquisition and processing. The method comprises the following steps: acquiring URL links from a plurality of social media platforms and common webpages as source data, wherein the source data correspond to webpage OG data lt; carrying out metagt; the label form is embedded into the lt of the HTML; carrying out headt; a label; performing validity check and standardization on the URL link, capturing webpage content by using an asynchronous HTTP (Hyper Text Transport Protocol) request library, and loading a complete HTML (Hyper Text Markup Language) on a dynamic webpage through a headless browser; the HTML positioning result is analyzed; carrying out metagt; tag: extracting an OG standard field and a platform extension field, and deducing a missing field from other HTML tags; mapping each platform OG field into a unified standard field; and outputting the OG data containing fields such as title and the like through the standardized API interface. According to the method, the multi-platform OG data acquisition efficiency, accuracy and safety are improved, good expansibility is achieved, and the cross-platform data integration requirement is met.

The invention relates to the technical field of artificial intelligence, and discloses a small language webpage adaptive collection method and device based on a large language model.The method comprises the steps that a target small language webpage is loaded and rendered through a headless browser, and a document object model tree structure is obtained; carrying out analysis and semantic annotation on the document object model tree structure based on a large language model, identifying dynamic content nodes and generating a self-adaptive content positioning rule; based on a self-adaptive content positioning rule, performing semantic vectorization on the at least two continuously collected webpage contents, and calculating semantic similarity; querying a preset frequency mapping rule according to the semantic similarity, dynamically adjusting the initiation frequency of a subsequent acquisition request, and generating an acquisition strategy; and executing the acquisition strategy to access the target webpage, and injecting an operation sequence for simulating human interaction behaviors in the acquisition process. Complete collection of the dynamic content of the small language webpage can be achieved, and continuity and stability of the collection process are guaranteed.

A computer-implemented method is provided that enables remote control of a headless browser. A message from a client to open a connection to a headless browser running on a device remote from the client is received. A command to provision the browser is sent to the headless browser. The command may configure the browser to appear as if the browser is controlled by a human. A command for controlling the headless browser is received from the client. The command is sent to the headless browser for execution. A response to the command is received from the headless browser. Finally, the response is forwarded to the client.

The invention discloses a Web honeypot automatic script identification and countering method based on a large language model and related equipment, and the method comprises the steps: obtaining a real IP address of an attack request through a WebRTC protocol; analyzing the attack request through a headless browser and a large language model, judging whether the attack request is an automatic script behavior or not, countering the attack request if the attack request is the automatic script behavior, and guiding the attack request to a honeypot if the attack request is not the automatic script behavior. The method can improve the accuracy of automatic script recognition, improves the honeypot stability, and can be widely applied to the technical field of network security.

The invention discloses a method and system for printing content in an APP through a headless browser, and belongs to the technical field of mobile office, and the system comprises a headless browser module which is used for rendering the content in the APP in the background and converting the content into data conforming to a printing format; the wireless connection module is used for detecting the printing equipment and establishing a stable communication channel; and the printing control module is used for receiving a printing instruction of a user, selecting a printer and sending a printing task. According to the system and the method, an efficient and stable mobile printing solution is realized, the processing capacity of a printing task and the accuracy of format conversion are greatly improved, the stability of the system under a high-load condition is ensured while server resources are released, and a reliable technical guarantee is provided for mobile office and on-site printing requirements.

The present disclosure relates to a method and device for implementing a headless browser cluster. The method comprises: assigning a corresponding accessible IP address to each server in a plurality of servers; wherein the plurality of servers form a cluster; installing a headless browser in each server; after receiving a headless browser starting instruction, starting a preset number of headless browser instances, the started headless browser instances forming a headless browser instance pool; after detecting that a headless browser instance acquisition instruction is received, acquiring a target headless browser instance available from the headless browser instance pool; acquiring a network socket endpoint address of the target headless browser instance; and sending the network socket endpoint address of the target headless browser instance to a client.

The invention discloses a website function accessibility evaluation method and device in an IPv6 single-stack environment, and belongs to the technical field of network function detection. The invention aims to solve the problem that in the prior art, website resource dependence and function accessibility cannot be comprehensively detected in an IPv6 single-stack environment. The method comprises the following steps: dynamically creating an isolated IPv6 single-stack network environment, starting a headless browser to capture all resource requests of a webpage, constructing a resource dependency graph, carrying out IPv6 reachability test on each resource, calculating a weighted accessibility score and generating a visual report. According to the method, the IPv6 single-stack user access behavior can be accurately simulated, the target website and all dependent resources of the target website can be comprehensively evaluated, a quantitative accessibility score and a visual dependency relationship visualization graph are provided, and accurate and operable diagnosis information is provided for website developers and operation and maintenance personnel.

The invention relates to the technical field of computers, and discloses a distributed document generation method based on a message queue and a headless browser, and the method comprises the steps: receiving a document generation request, packaging the document generation request into a standard task object, and verifying the validity of a rendering target; splitting an original task into sub-tasks, and calculating task fingerprints and time-carrying task fingerprints; the core parameters and the service data loads are separately stored; converting the effective sub-tasks into rendering instructions, and performing queue arrangement according to the calling mode of the sub-tasks; and taking a headless browser as a rendering processing unit, continuously consuming a rendering instruction from the message queue, carrying out webpage rendering, converting the rendered webpage into a document, and responding to a document generation request. The headless browser is used as a core rendering processing unit, high-fidelity restoration of webpage content is achieved, and the visual quality and accuracy of the generated document are improved.

A method includes receiving, at a native application, access credential data and providing the access credential data from the native application to a headless browser. The method also includes initiating a secured connection from the headless browser to a remote server that hosts a website. The remote server supports access to secured data without relying on an application programming interface. The method also includes sending, by the headless browser via the secured connection, the access credential data to the remote server. The method also includes receiving first web page data of the website from the remote server via the secured connection and parsing the first web page data to identify user-specific data. The method further includes receiving, by the headless browser via the secured connection, at least a portion of the secured data.

The invention provides a document exporting method, a related device and a medium. The method comprises the following steps: receiving an export request for a currently presented document; and in response to the export request, sending rendering basic data of the currently presented document at the client to the document server, so that the document server executes the data presentation control by using the headless browser to execute rendering of the rendering basic data without a client rendering tool of the client for rendering the rendering basic data, utilizing a file tool of the headless browser to file the rendering result into an export document of the current presentation document; a derived document is received from a document server. According to the embodiment of the invention, the export efficiency of the online document is improved, and the export of the online document in a self-defined format can also be realized. The embodiment of the invention is applied to scenes such as online office and data export.

The application provides a kind of active defense-oriented dynamic deception domain name honeypot generation method and system, it is related to network security active deception technical field, specific scheme: based on headless browser access and save the web page of real business, the type of the web page is analyzed and different strategies are recorded to obtain web variables, based on re-renderer component rendering the web variables are cloned to obtain simulation web page, the simulation web page is packaged and combined with known container template to build container image to obtain honeypot device container;Based on the honeypot device container, attack logs are collected and marked, and the optimal cycle is obtained based on the multi-objective optimization algorithm, and the cycle of the false domain name bound to the honeypot device container is dynamically adjusted based on the optimal cycle to obtain the domain name honeypot.The application improves the problem that domain name is difficult to adapt to the change of attacker strategy and is difficult to dynamically optimize the defense strategy according to the behavior of the attacker.

The application discloses a kind of methods for assisting large model networking query, the method is by receiving and encapsulating as standardization demand to parse user query request, matching dynamic residential proxy IP pool, IP dynamic rotation and load balancing mechanism are started, generate standardization collection task, realize multi-platform data scraping through multi-tool cooperation, anti-crawling avoidance and high concurrency scheduling, clean, double check and structure transformation are carried out to original data, add standardization field annotation, push structured data to large model and monitor data satisfaction degree;The application is through dynamic residential proxy IP pool and IP rotation mechanism, avoid regional restriction and anti-crawling interception, with headless browser, API identification technology, adapt to dynamic and waterfall page, improve collection integrity and efficiency, after cleaning, check and structure transformation, combined with automatic completion query condition and daily optimization mechanism, the accuracy, timeliness and stability of large model real-time query response are greatly improved.

The application discloses a front-rear end cooperative large PDF file intelligent generation method, relates to the technical field of computer software, and comprises the following steps: front-end rendering: the front end renders the work order data page by combining a headless browser with a Vue framework and an ElementUI component library, and dynamically displays structured work order details through a responsive data binding mechanism; data fragmentation: large work order data sets are split into N subtasks based on a dynamic fragmentation strategy; and small PDF files are generated in parallel: a containerized rendering cluster based on Kubernetes deployment management is used to allocate rendering tasks to each container; the small PDF files generated by the application through careful design with the help of the Vue and ElementUI frameworks are more attractive in terms of text layout, color matching and graphic display, and the large file after merging is more beautiful than the file generated by a traditional back end, thereby improving user experience.

The invention belongs to the technical field of computer technology, and discloses an H5 page real-time monitoring method based on a headless browser, which comprises the following specific steps: step 1, processing flow: the system processing flow is divided into a user configuration flow and a simulated user behavior processing flow; in the user configuration process, a user configures a page for monitoring configuration, the user fills in the page needing to be monitored in real time, and the behavior of the user is simulated after the page is loaded; and step 2, page monitoring. According to the headless browser-based H5 page real-time monitoring method and system provided by the invention, a user can clearly operate in a short time through simple configuration; according to the invention, the system engineering is extensible, each component is in a pluggable design, and a data source, an alarm mode and a display mode can be replaced according to needs; according to different scenes, abstract configuration, rapid trial and error and self-inspection discovery can be realized as much as possible; and a solution scheme for monitoring the H5 page in real time is realized.

The invention discloses a front-end page patrol method and device. According to one specific embodiment, the method comprises the steps that a preset page list is obtained, and the page list comprises page information of a front-end page to be patrolled; accessing a front-end page corresponding to the page list through a headless browser, and determining a page access result; and according to the page access result, determining a page patrol result of the front-end page corresponding to the page list. The page patrol result of the front-end page is determined on the basis of the headless browser for the page access result of the front-end page, the labor intensity and the labor cost in the page patrol process are reduced, and the efficiency and the accuracy of the page patrol process are improved.

The invention discloses a flow chart-based training data generation method, training data generation equipment and a medium, relates to the technical field of flow chart processing, and discloses a flow chart-based training data generation method, which comprises the following steps of: analyzing natural language input information based on a deep seeking model, obtaining a JSON object containing attributes between nodes and edges of the flow chart; constructing a hypertext markup language template for rendering the flow chart according to the random visual style, and embedding the JSON object into the hypertext markup language template to obtain a hypertext markup language file; generating an image file of the hypertext markup language file based on the headless browser; and determining annotation information of the flow chart according to the image file, packaging the annotation information to a JSON object to obtain a JSON annotation file, and inputting the JSON annotation file and the image file as training data into the deep learning model. On the basis, the model training effect is improved through diversified training samples.

The invention provides a proxy AI-based phishing webpage intelligent detection system and method, and the system is characterized in that the system comprises a link input module which is used for receiving a to-be-detected URL, and carrying out the preliminary filtering; the headless browser control module is used for controlling a headless browser to load a page and managing the life cycle of the page; the page content extraction module is used for extracting page information from the headless browser; manual analysis requirements are reduced through automatic interaction, the detection efficiency is improved, and the method is suitable for large-scale mail security scanning scenes; an interaction path and a decision process can be recorded, a transparent log is provided for security analysis, and subsequent optimization and auditing are facilitated.

The present invention discloses a Web project inspection method and system, comprising the following steps: starting a headless browser, obtaining a Web project route, the Web project route comprising a Web project route structure and a plurality of pages, the Web project route structure comprising a path relationship between the plurality of pages; reading the Web project route, the headless browser sequentially running each page according to the Web project route structure, recording the error content and position whenever an error occurs on a page, until each page in the Web project route is run and completed, and then terminating the inspection; collecting all error contents and their corresponding positions, obtaining an error log, and returning the error log. The present invention performs a running test on all pages of a Web project according to the route structure by a headless browser, utilizes the feature that the headless browser does not need to be rendered, improves the test speed, and can exhaustively test all pages through the route structure, saving the manpower cost and time cost of project inspection.

The invention provides a data processing method and device, electronic equipment, a storage medium and a program product. The method comprises the following steps: in response to a received first operation request for a front-end page, generating a screenshot request and sending the screenshot request to middleware service; the screenshot request is generated based on screenshot operation on at least part of page information including third-party resource information in the front-end page; the middleware service starts a headless browser based on the screenshot request, and loads the front-end page through the headless browser; the middleware service performs screenshot on at least part of page information of the headless browser to obtain a target image, and sends the target image to the front-end page; and the front-end page generates target content corresponding to the first operation request based on the target image. According to the data processing method and device, the electronic equipment, the storage medium and the program product, screenshot of cross-domain resources can be achieved.

The embodiment of the invention discloses a signature method and device for a webpage snapshot, and the method comprises the following steps: loading a target webpage in a uniformly configured headless browser environment, automatically detecting and removing dynamic contents in the target webpage according to a preset dynamic element recognition rule, and generating purified webpage document object model (DOM) data; in the webpage state after the de-dynamic processing, respectively collecting standardized webpage DOM data and a webpage rendering image snapshot; hash abstracts of the webpage DOM data and the webpage rendering image snapshot are calculated respectively, and two abstract values obtained through calculation are combined to generate a webpage snapshot signature; and storing the webpage DOM data, the webpage rendering image snapshot, the webpage snapshot signature and the corresponding metadata information in a secure storage medium together. According to the embodiment of the invention, the consistency and reproducibility of webpage snapshot contents can be improved, the tamper-proof capability of webpage evidence storage is enhanced, and the accuracy and robustness of tamper detection are improved.

The invention provides a webpage picture obtaining method and device, electronic equipment and a storage medium, and the method comprises the steps: receiving a picture conversion request which comprises a target website needing to be converted; calling a headless browser, and performing screen capture operation on a webpage corresponding to the target website to obtain target picture data; and storing the target picture data to a preset storage position, and returning the preset storage position to a sender of the picture conversion request. After the picture conversion request is received, the server calls the headless browser to perform the screenshot operation on the original webpage corresponding to the target website to obtain the target picture data, and since the screenshot operation is performed on the original webpage, the screenshot operation does not need to be performed on the basis of the conversion result after other conversion is performed on the original webpage, so that the user experience is improved. And the definition loss of the picture in the webpage is reduced, so that the definition of the obtained webpage picture is improved.

The invention relates to the technical field of testing, and provides a testing method and device, equipment and a medium, which can create at least one virtual display in a Docker container without a graphical interface so as to provide normal operation conditions for a test case needing a header browser. Circularly detecting the occupancy condition of the environment variable lock, and configuring the environment variable lock corresponding to each virtual display according to the detection result corresponding to each virtual display and the display identifier of each virtual display, each virtual display and the corresponding head browser are bound according to the environment variable lock corresponding to each virtual display, so that starting failure caused by the fact that threads of the virtual displays preempt the environment variables is avoided; according to the embodiment of the invention, the test case corresponding to the header browser is executed in parallel based on each virtual display, so that the problem that the header browser cannot run on a non-graphical interface to efficiently execute an automatic test can be effectively solved in a test scene needing to depend on real graphical interface interaction.

The invention discloses a business mail automatic processing method and system based on robot process automation. The method comprises the following steps: automatically analyzing a theme, a text and an attachment of a received mail through a natural language processing technology, extracting key information such as an enterprise ID (Identity), a chemical identifier and a mail type, and converting the key information into structured data; identifying task types according to the data and selecting corresponding automatic processes; a headless browser is used for simulating and logging in a third-party system, and automatic processing including attachment downloading, analysis, screenshot and multi-language translation is executed; the execution state is monitored in real time, the success rate and the average time are counted to optimize the performance, and meanwhile, various abnormities are captured and reports are generated to trigger the processing flow; and cleaning the resources after execution is finished, and generating a notification mail based on a result to send and archive. According to the scheme, full-process automation of mail processing is realized, and efficiency and accuracy are remarkably improved.

The invention discloses a front-end and rear-end collaborative intelligent generation method for a large PDF (Portable Document Format) file, which relates to the technical field of computer software and comprises the following steps: front-end rendering: a front end renders a work order data page through a headless browser in combination with a Vue framework and an Element UI (User Interface) component library, and dynamically displays structured work order details through a responsive data binding mechanism; data fragmentation: segmenting the large-scale work order data set into N subtasks based on a dynamic fragmentation strategy; generating small PDF files in parallel; deploying a managed containerized rendering cluster based on Kubernetes, and distributing a rendering task for each container; according to the method, the front end is elaborately designed by means of Vue and Element UI frames, the generated small PDF file is more attractive in character typesetting, color matching and graphic display, the attractiveness of the combined large file is far better than that of a traditional file generated at the rear end, and the user experience is improved.

The invention provides an active defense-oriented dynamic deception domain name honey point generation method and system, and relates to the technical field of network security active deception, and the specific scheme is as follows: accessing and storing a webpage of a real service based on a headless browser, analyzing the type of the webpage, and recording by adopting different strategies to obtain webpage variables; rendering the webpage variable based on a re-renderer component, then performing page cloning to obtain a simulation webpage, packaging the simulation webpage, and constructing a container mirror image in combination with a known container template to obtain a honey point equipment container; and collecting and marking an attacker request based on the honey point device container to obtain an attack log, obtaining an optimal period based on a multi-objective optimization algorithm, and dynamically adjusting the period of binding the false domain name to the honey point device container based on the optimal period to obtain the domain name honey point. The problems that the domain name is difficult to adapt to the strategy change of an attacker and the defense strategy is difficult to dynamically optimize according to the behavior of the attacker are solved.