Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

20 results about "Web extraction" patented technology

Visual deep learning for inline phishing detection

Techniques for visual deep learning for inline phishing detection are disclosed. In some embodiments, a system / process / computer program product for visual deep learning for inline phishing detection includes extracting a logo from a screenshot of a web page; detecting phishing based on a match to at least one of a plurality of reference logos using a visual deep learning model and that a domain associated with the web page is not associated with an entity that matches the logo extracted from the web page; and performing a remedial action in response to determining that the web page is associated with phishing.
Owner:PALO ALTO NETWORKS INC

Threat intelligence analysis method based on large-scale model collaboration

The invention relates to the field of intelligent intelligence analysis, in particular to a threat intelligence analysis method based on large-scale model collaboration. Threat intelligence content information is extracted from a dark web webpage by adopting a natural language processing technology based on deep learning, and global content information semantic feature extraction and keyword information semantic feature extraction are respectively performed on the threat intelligence content information; and performing fine-grained context semantic association reinforcement on global content information based on the keyword information of the threat intelligence so as to realize deep understanding and structured representation of the content of the threat intelligence. Therefore, the unstructured threat intelligence report can be effectively converted into the structured data, and the utilization efficiency and the analysis accuracy of the threat intelligence can be improved.
Owner:STATE GRID HENAN INFORMATION & TELECOMM CO +2

Computer-implemented system and method for providing website navigation recommendations

A system and method for providing Website navigation recommendations is provided. A Web page of interest is identified as a destination Web page. A domain of Web pages related to the destination Web page is determined. Information is extracted from each Web page in the domain and a recommendation comprising instructions for navigating to the destination Web page is generated based on the extracted information.
Owner:PALO ALTO RESEARCH CENTER INC

Traffic facility attribute mining method and system based on multi-modal network open source data

The invention relates to a traffic facility attribute mining method and system based on multi-modal network open source data. The method comprises the following steps: extracting traffic facility information from a webpage to construct a knowledge graph; extracting positions and appearances of traffic facilities from the images, and analyzing streetscape images to obtain attributes such as road traffic; collecting map images, tiles and vector data to construct a road network topology and attribute database; associating webpage texts, pictures, streetscape images and network map multi-source data according to the spatial position of the traffic facility; through comprehensive and deep attribute mining, different modal data are integrated to improve the accuracy and reliability of attribute mining, the real-time and dynamic updating capability, the convenient visualization and interaction operation, the data sharing and integration convenience, and the traffic facility management efficiency and collaboration are improved. According to the method, comprehensive, accurate and real-time traffic facility attribute data support can be provided for urban traffic planning, traffic management and intelligent traffic system construction, so that the efficiency and the intelligent level of traffic facility management are remarkably improved.
Owner:NAT UNIV OF DEFENSE TECH

Unified parked domain detection system

ActiveUS12229647B2EngineeringData mining
The present application discloses a method, system, and computer system for detecting parked domains. The method includes obtaining, by one or more processors, a set of webpages corresponding to a plurality of domains, extracting a plurality of features based on the set of webpages, detecting parked domains based on the plurality of features using a machine learning model, and periodically applying automatic signature generation to detect a new pattern of parked domains without retraining the machine learning model.
Owner:PALO ALTO NETWORKS INC

A web page deduplication method based on structure perception

The invention discloses a webpage deduplication method based on structure perception, which belongs to the fields of security, infrastructure and IT support technology, and includes: step 1, webpage collection; step 2, parsing the URL of the collected webpage and generating a URL parameter feature tag; step 3, constructing a URL feature information and difference analysis result mapping table, initializing comparison and filtering the collected webpage, and updating the URL feature information and difference analysis result mapping table; step 4, if the collected webpage is not filtered, extracting a weighted area for the collected webpage according to the URL feature information and the difference analysis result mapping table, and calculating the SimHash value of the collected webpage; step 5, judging whether there is a similar webpage to the collected webpage according to the SimHash value of the collected webpage and the webpage URL, and if there is a similar webpage, performing deduplication processing. The method improves the deduplication efficiency and accuracy, and is suitable for efficient and accurate deduplication processing of large-scale webpage data.
Owner:NAT COMPUTER NETWORK & INFORMATION SECURITY MANAGEMENT CENT JIANGSU BRANCH +2

Web object maintenance in a software application testing environment

Methods and systems are described for web object maintenance in a software application testing environment using reinforcement learning. A server detects failure of a test script caused by a web object of the software application. The server identifies the web object that caused the failure using code elements extracted from a webpage, including: determining, for each code element, actions to be performed against the code element, executing a deep neural network model to generate a reward value by applying each action to properties of the code element, selecting the code element having a maximum reward value, and classifying the code element upon comparing properties of the selected code element to properties of web objects in a repository. The server updates a web object in the repository to comprise the selected code element and the properties. The server resumes execution of the test script using the updated web object.
Owner:FMR CORP

Service monitoring data enhancement method, system and device based on LLM and retrieval enhancement generation and storage medium

The invention discloses a service monitoring data enhancement method, system and device based on LLM and retrieval enhancement generation and a storage medium, and relates to the technical field of service monitoring and exception handling. The method comprises the steps that user exception description is received, a webpage is retrieved through semantic expansion, and triple output structured data is extracted; and comparing with a local knowledge base, processing and storing the new content classification vector, and updating the index. Performing preliminary screening and reordering by combining exception description and an update library, taking a front list as a context to enable a large language model to generate analysis, evaluation and a strategy, and performing rule check and output; a result is verified, scene variants are generated according to exception types, after duplicate removal, the scene variants, strategies and metadata are structurally stored in a knowledge base, and continuous learning of a closed loop is completed; according to the method, high-quality and high-timeliness service exception training data and processing strategies can be automatically generated, the illusion problem of a large language model in actual operation and maintenance is effectively solved, and the fault response speed and the decision accuracy are improved.
Owner:GUANGXI POWER GRID CORP

Visual deep learning for inline phishing detection

Techniques for visual deep learning for inline phishing detection are disclosed. In some embodiments, a system / process / computer program product for visual deep learning for inline phishing detection includes extracting a logo from a screenshot of a web page; detecting phishing based on a match to at least one of a plurality of reference logos using a visual deep learning model and that a domain associated with the web page is not associated with an entity that matches the logo extracted from the web page; and performing a remedial action in response to determining that the web page is associated with phishing.
Owner:PALO ALTO NETWORKS INC

Browser advertisement interception system and method

The invention relates to the technical field of Internet, in particular to a browser advertisement intercepting system and method. Comprising a management and control cloud platform, a data display module, an interception execution module, an advertisement recognition module, a webpage analysis module and an advertisement containing module, the webpage analysis module is used for analyzing a webpage loaded by a browser and extracting page structure information, and the advertisement recognition module is used for receiving and analyzing webpage content and extracting the webpage structure information. The method comprises the following steps: identifying advertisement elements through an identification algorithm and a rule base, intercepting the identified advertisement elements by an interception execution module according to an identification result, accommodating advertisement information of a webpage by an advertisement accommodating module, minimizing the advertisement information in a browser, and displaying an interception record to a user through a data display module. Therefore, the advertisement content in the web browser can be intelligently identified and efficiently intercepted, and the browsing experience of the user is greatly improved.
Owner:SHANGHAI BOSE INFORMATION TECH CO LTD

News pushing method and device, computer program product and news pushing system

The invention provides a news pushing method and device, a computer program product and a news pushing system. The method comprises the following steps: extracting a plurality of initial news from a webpage; news in which the target object is interested is screened out from the multiple pieces of initial news, multiple pieces of target news are obtained, and the number of the target news is smaller than or equal to the number of the initial news; the target news is sorted according to the importance degree of the target news, the sorted target news is obtained, and the importance degree is the degree of the influence of the target news on the target object; the sorted first N pieces of target news are pushed to the target object, and N is larger than or equal to 1. According to the method, the problems that in the prior art, news screening and sorting depend on manual screening, expert evaluation or simple statistical analysis, obvious limitation and defects exist, and news cannot be accurately recommended to the user are solved.
Owner:PEKING UNIV CHONGQING RES INST OF BIG DATA +1

Product weight prediction device and product weight prediction method

A product weight prediction device disclosed in the present document comprises: a communication interface for receiving user input data related to an order of a product; and at least one processor for extracting product information of the product from a web page on the basis of the user input data, generating preprocessed data by embedding the product information, and predicting a weight of the product by inputting the preprocessed data to a learning model, an input value of which is the preprocessed data and an output value of which is a predicted weight of the product.
Owner:SHAASHOP INC

Webpage duplicate removal method based on structure perception

The invention discloses a webpage deduplication method based on structure perception, which belongs to the technical field of security, infrastructure and IT support, and comprises the following steps of: 1, collecting a webpage; 2, the URL of the collected webpage is analyzed, and URL parameter feature tags are generated; step 3, constructing a URL feature information and difference analysis result mapping table, performing initialization comparison and filtering on the collected webpage, and updating the URL feature information and difference analysis result mapping table; 4, if the collected webpage is not filtered, extracting a weighted area from the collected webpage according to the URL feature information and the difference analysis result mapping table, and calculating a SimHash value of the collected webpage; 5, according to the SimHash value of the collected webpage and the webpage URL, whether similar webpages exist in the collected webpage or not is judged, and if the similar webpages exist, duplicate removal processing is carried out. According to the method, the de-duplication efficiency and accuracy are improved, and the method is suitable for performing efficient and accurate de-duplication processing on large-scale webpage data.
Owner:NAT COMPUTER NETWORK & INFORMATION SECURITY MANAGEMENT CENT JIANGSU BRANCH +2

A webpage data collection and dynamic monitoring method, device and equipment

This invention discloses a method, apparatus, and device for webpage data acquisition and dynamic monitoring. The method includes responding to a data monitoring task, initializing a simulated browser according to the task cycle corresponding to the data monitoring task, and accessing the webpages on the list to be monitored specified by the data monitoring task; traversing the webpages on the list to be monitored and extracting webpage element data; if the webpage element data is plain text, extracting the text corresponding to the plain text element; if the webpage element data contains image elements, performing optical character recognition on the images corresponding to the image elements to generate image recognition results; using the text and image recognition results, constructing a blacklist and performing fuzzy matching with the list to be compared, and pushing early warning information according to the fuzzy matching results. This method, combined with the simulated browser, performs categorized identification and simulated matching of webpage elements, improving identification accuracy while ensuring monitoring efficiency.
Owner:创优数字科技(广东)有限公司

Model ensemble for matching nearest script to a new script page

A method including extracting a number of page features from a web page. The number of page features represent an executable logic of the web page. The method also includes embedding, by a page feature embedding model, the number of page features to generate a page vector data structure. The method also includes comparing, by a comparison model, the page vector data structure and a number of script vector data structures to identify a selected script. Each of the number of script vector data structures is generated by a script feature embedding model processing computer executable program code of a corresponding script for performing a computer function on a web page. The method also includes presenting the selected script.
Owner:INTUIT INC

A web page content integrity detection system and method based on data analysis

The application relates to the technical field of webpage identification detection, in particular to a webpage content integrity detection system and method based on data analysis, which comprises the following steps: extracting user browsing operation records of each to-be-detected webpage in a time period, capturing browsing transfer operations generated between the corresponding to-be-detected webpages and repeated browsing operations generated on the corresponding to-be-detected webpages based on the user browsing operation records, and constructing corresponding first user browsing transfer links and second user browsing transfer links; locking the to-be-detected webpages suspected of having content missing, calculating the first browsing transfer rate of each target to-be-detected webpage, and completing the first calibration screening; calculating the second browsing transfer rate of each target to-be-detected webpage, and completing the second calibration screening; and assisting operation and maintenance personnel in fault screening of each target to-be-detected webpage in a target to-be-detected webpage sequence received in real time.
Owner:HAINAN INFOBAHN TECH SERVICE CO LTD

Multi-modal automated evaluation for improved accessibility

One example method includes a machine-learning (ML) model receiving a first input that includes images that have been extracted from a web page and a second input that includes alt-texts that have been extracted from the web page. The alt-texts describe the images. The ML model converts the images into a first embedding representation and converts the alt-texts into a second embedding representation. Based on the first and second embedding representations, a similarity score between the images and the alt-texts is calculated. The similarity score specifies how accurately each of the alt-texts describe the images. The one of the alt-texts having the highest similarity score is then selected.
Owner:DELL PROD LP

Data extraction using llms

PendingUS20260187174A1Data ingestionEngineering
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving information identifying a domain to be analyzed and identifying an entity referenced by the domain. The domain is queried, and a plurality of web pages located within the domain are received. The plurality of web pages is inputted into an artificial intelligence system that includes a large language model which extracts first content from a first web page among the plurality of web pages. The artificial intelligence system extracts second content from a second web page, the second content in a second format that differs from the first content. The artificial intelligence system generates third content representing a characterization of the entity based on the extracted first and second content. The generated characterization is an interpretation of the extracted first and second content.
Owner:GOOGLE LLC

Framework for exposing context-driven services within a web browser

Systems and methods for securely exposing context-driven services within a web browser. An example method includes receiving manifests from hubs apps (e.g., remote services). The manifests define requested context types for the hub apps. When the web browser loads a web page, the web browser may execute context extractors to extract context from the web page. The context extractors that are executed are based on the context types requested by the hub apps. The extracted context is then sent to the corresponding hub apps without providing the hub apps direct access to the web page. For instance, the hub apps do not have access to the document object model (DOM) of the web page and the hub apps cannot inject data into the web page.
Owner:MICROSOFT TECHNOLOGY LICENSING LLC

Verified entity attributes

Systems and methods enable an entity to certify a web page address as being linked to the entity. The web page address includes semantic web mark-up identified attributes for the entity. A system may extract the attributes from the web page for the entity and use the attributes to generate an information card for the entity. The certification process ensures that the attributes are accurate, so that information cards generated for the entity are of high quality and reliable. Implementations may also simplify maintenance and quality assurances processes for an entity repository.
Owner:GOOGLE LLC