58 results about "Web extraction" patented technology

A method and system for automated identification of phishing, phony, and malicious web sites are disclosed. According to one embodiment, a computer implemented method, comprises receiving a first input, the first input including a universal resource locator (URL) for a webpage. A second input is received, the second input including feedback information related to the webpage, the feedback information including an indication designating the webpage as safe or unsafe. A third input is received from a database, the third input including reputation information related to the webpage. Data is extracted from the webpage. A safety status is determined for the webpage, including whether the webpage is hazardous by using a threat score for the webpage and the second input, wherein calculating the threat score includes analyzing the extracted data from the webpage. The safety status for the webpage is reported.

A crawler collects webpage data and obtains a list of URL's of interest used to construct a searchable index. The HTML stream is received for each relevant URL and each HTML stream is imported onto a browser or rendering engine so as to render the page. From the browser, the run-time data structure for each page is obtained. From the run-time data structure, layout information of the webpage is obtained. The layout information can include location and size of images, text, video clips, banners, etc. Using various heuristics, selected items of interest are identified as relevant according to their associated layout information. Then, when a query is received and a match is found in the index, only the information identified as relevant is fetched and presented to the user.

Embodiments of the invention describe a computer-implemented method for extracting data from web pages. During a learning stage, the embodiments receive a template web page represented by a template Document Object Model (DOM) and select a record node, which is a root node of a sub-tree of the template DOM that contains data to be extracted. After that, a record node sub-tree and data field sub-paths are stored in a memory, wherein the record node is a root node of the record node sub-tree, and the data field sub-paths are relative paths of the template DOM from the record node to data field nodes. During the extraction stage, a web page represented by a DOM-tree is received and a matched sub-tree of the DOM-tree according to a structure of the record node sub-tree is identified. Next, data from the matched sub-tree according to the data field sub-paths are extracted.

The invention provides an image search method and a search engine thereof. The method obtains similar images by crawling the obtained pictures on the whole network, extracts the context and subject information of the pictures from the source webpage of the similar images, and finally provides the search results of the images comprehensively according to the semantic features and visual features of the images . The image search engine includes an acquisition module, a primary search module, a secondary search module, a word segmentation module and a determination module. The acquisition module obtains the source image, the primary search module obtains a similar image set, and the secondary search module establishes a data structure of web page information of the similar image set. The word segmentation module marks the position weight of the picture context, extracts the longest phrase and marks the word weight, and the determination module extracts the core subject words and crawls relevant picture information. The present invention provides a search engine and search method that more comprehensively uses images to search subject information and related images, and users can generate different needs according to different scenarios and achieve specific effects.

A method and apparatus for extracting information from a web page on a standard end user browser without plug-ins, includes the steps of dynamically creating an element on a web page being viewed by an end user, copying at least a portion of the contents of the web page or form field values, and uploading the data to a target domain, wherein the target domain may be different from the domain of the web page. In co-browsing applications, the data uploaded is used to create a copy of the website for display to a third party.

The invention discloses a system for extracting Web information based on Nutch. The system comprises an information extraction module, a storage module, an index module and a retrieval module, wherein the information extraction module is used for capturing webpage data from the Internet through a Nutch frame and analyzing the data; the storage module is used for storing webpage extraction files in which the webpage data is filtered; the index module is used for transmitting the webpage information collected by the Nutch to Solr to establish an index; the retrieval module is used for using the Solr to respond to a user query request and displaying the query result to a user in an XML page form. The response and running sped, stability and expandability of information extraction are improved, the excessive storage space occupied by the program is reduced, and guarantees are provided for the fact that the user can obtain effective information in time.

The invention provides a method and a device for extracting webpage content. The method comprises the following steps: based on a digital document analyzing (DDA) method, extracting the webpage content of an input webpage to generate a DDA extraction result; based on a document image recognition (DIR) method, extracting the webpage content of the input webpage to generate a DIR extraction result; and merging the DDA extraction result and the DIR extraction result to generate a merging result. The method and the device can acquire better webpage extraction result compared with the prior art.

The invention discloses a webpage extraction method based on attribute reproduction and labeled path. The web extraction method comprises the following steps of: constructing an attribute value seed set through extracting a target website or an attribute value list page, wherein part value of a target attribute is contained; acquiring a partial sample page, and determining a relative labeled path, between an attribute name and an attribute value, of each attribute; downloading a partial page, constructing a training sample base, and storing the acquired codes in a local database; inquiring and labeling all reproductions of each seed attribute value in the training webpage, recording to the labeled path corresponding to each reproduction; taking the labeled path with highest support to a same attribute webpage as an extraction rule for extracting other webpage information except the training samples; accessing other webpage HTML (Hypertext Markup Language) trees in the target website by using the acquired labeled path, locating the label where the attribute value is, and extracting a text character string; and deleting the attribute value without the attribute name or with an incorrect attribute name, and storing the correct attribute value into the local database, thereby finishing the attribute value extraction of page attribute.

An electronic device and a method for providing content on the electronic device are provided. The method includes receiving webpages from information sources, extracting intent data related to an object in the webpages, transmitting the extracted intent data to a server, and receiving, from the server, a content list including a content index that is determined based on the transmitted intent data.

The invention discloses a Hadoop cluster-based large-scale Web information extraction method and a Hadoop cluster-based large-scale Web information extraction system, aiming at the problem that a single node cannot be competent to the requirement for large-scale Web information extraction. The method comprises the following steps that an aggregation processing node extracts a website seed to be inquired according to predetermined conditions, performs load balancing segmentation according to the processing capacity of each query node, and transmits the seed to be inquired to each query node; each query node performs Web extraction locally according to the seed to be inquired and reports to the aggregation processing node; the aggregation processing node aggregates the reported information to obtain large-scale Web information. According to the method and the system, massive data extraction is performed in a Hadoop cluster mode, and data are processed by a high-efficiency Hbase-type memory database; the extraction efficiency is greatly improved compared with a single machine and a traditional relational database, and the reliability and the expansibility are high.

A seat belt retractor for a safety belt of a motor vehicle having a belt shaft (1) rotatably mounted in a frame, a profile head (2) lockable in relation to the frame, a load limiting device (20) located between the profile head (2) and the belt shaft (1) for enabling the belt shaft (1) to undergo a load limited rotation in the belt webbing extraction direction (A) with the profile head (2) being locked and a load limiting level predetermined by the load limiting device (20) being exceeded. the load limiting device (20) is formed from at least two load limiting elements (4, 5), by the activation of which the load limiting level can be switched from a lower to a higher level during the load limited belt webbing extraction, a first load limiting element (4) with a higher load limiting level is provided, which load limiting element with a first end (4a) is connected to the profile head (2), and a second load limiting element (5) with a lower load limiting level is provided, which load limiting element with a second end (5b) is connected to the belt shaft (1), and the second end (4b) of the load limiting element (4) with the higher load limiting level is connected to the first end (5a) of the load limiting element (5) with the lower load limiting level via a connecting element (6), and a coupling element (7) is provided for coupling the connecting element (6) to the belt shaft (1), via which coupling element the connecting element (6) can be coupled to the belt shaft (1) after the same has performed a rotation of a predetermined angle.

Included are embodiments for providing a topic map. At least one embodiment of a method includes receiving a plurality of web pages, the web pages including metadata, extracting at least a portion of the metadata from the web pages, and creating at least one topic associated with the web pages, the at least one topic corresponding to at least a portion of the metadata.

An apparatus for sharing Web contents is provided. The apparatus includes a Web browser that loads and outputs a Web page, and a Web content transmission client that is linked with the Web browser to extract context information that is current state information from the Web page, and transmits the extracted context information to at least one other terminal.

A method of printing a web page by using a mobile terminal and a mobile terminal are provided. The method includes displaying the web page on the mobile terminal, extracting objects that are to be printed from the web page displayed on the mobile terminal, setting a layout of the extracted objects, and generating printing data by rendering the objects according to the layout.

The invention provides a method for detecting a malicious website. The method comprises the steps that a target webpage pointed to by a target web address of a target website to which a user has access is acquired, and a contact way in the target webpage is extracted; a malicious contact way database is searched for target information data matched with the contact way in the target webpage, wherein information data determined as a malicious contact way are stored in the malicious contact way database; when the target information data matched with the contact way in the target webpage are acquired, the target website is determined as the malicious website, and the target website is written into a malicious web address database. In addition, the invention provides a device for detecting the malicious website. According to the method and device for detecting the malicious website, the efficiency of detecting the malicious website can be improved.

This invention provides a terminal searching for web pages on the web and extracting the prescribed data from the web pages and a server verifying and accumulating the extracted data. The prescribed data can be extracted from the web pages on the web in a manner that the process relating to the data extraction is distributed between the terminal and the server. Therefore, necessary processes up to the data extraction are distributed, and the burden placed on each apparatus can be lessened. Further, new data not formerly found in the web pages can be found out and extracted from the web pages that has been updated or newly made.

An aspect of the present invention provides a passenger protection device that includes, a brake pedal sensor configured to detect the amount by which a brake pedal of a vehicle is operated, a webbing, one end of the webbing fixed to the vehicle, configured to restrain a passenger seated on a seat of the vehicle, a retractor connected to the other end of the webbing, the rector configured to retract the webbing and inhibit of the webbing extraction, and an ECU electrically coupled to the brake pedal sensor, the ECU configured to detect that the brake pedal operation amount detected by the pedal sensor exceeds a first threshold value, the ECU configured to revise the threshold value based on safety related information of the vehicle to control the inhibition of the webbing extraction of the retractor.

The invention relates to a self-locking seat belt retractor having the following components:

a locking device (9) which can be actuated in a vehicle-sensitive and/or in a belt webbing-sensitive manner,

a belt shaft (1), upon which the belt webbing can be wound,

a two-stage load limiting device (13) located within the force flow between the locking device (9) and the belt shaft (1) for allowing a load-limited belt webbing extraction during a load limitation,

the load limiting device (13) includes a first load limiting element (3) having a high load limitation level and a second load limiting element (2) having a low load limitation level, the load limitation level can be switched from the high load limitation level to the low load limitation level during the load limitation,

a third load limiting element (14) parallel to the second load limiting element (2) with the low load limitation level is provided between the locking device (9) and the belt shaft (1), wherein the third load limiting element (14) is formed by at least two structural elements (10, 11, 12, 20a, 20b, 21a-21g, 22a-22g) resting against each other within the force flow between the locking device (9) and the belt shaft (1), at least one of which structural elements is sheared off during the load limitation.

A method for operating a self-orchestrated system for extraction, analysis, and presentation of entity data involves extracting a web page to object-based storage including web page content, web page metadata and a globally unique identifier. The method extracts the web page metadata from the object-based storage. The method inputs the web page metadata to a queue. The method pulls web page content from a content store. The method receives RegEx from a model parameter store. The method parses the web page content using RegEx and web page metadata. The method passes web page metadata and extracted content from the web page and positions of extracted content to an advanced analysis function decider (AAF Decider) for analysis. The method streams web page metadata and extracted content from the web page and positions of the extracted content to a JSON file batch for flattening.