A method for collecting real-time information on dynamic pages of the Internet of Things

A technology of dynamic pages and collection methods, applied in the field of data processing, can solve the problems of poor scalability and single data format, and achieve the effect of satisfying processing requirements and good scalability.

Active Publication Date: 2018-01-02
BEIJING DIWINET TECH CO LTD
View PDF1 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the current web crawlers or page collection tools cannot realize real-time capture of dynamic data, and the obtained data has a single format and poor scalability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A method for collecting real-time information on dynamic pages of the Internet of Things
  • A method for collecting real-time information on dynamic pages of the Internet of Things
  • A method for collecting real-time information on dynamic pages of the Internet of Things

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0025] Need to use Web automated testing framework Watir in the present invention, Ruby parses XML, HTML storehouse Nokogiri, technologies such as CSSSelector, these technologies are described as follows respectively:

[0026] 1) Watir, an automated testing tool

[0027] The full name of Watir is "Web Application Testing in Ruby". It is an open source web automation testing framework implemented in Ruby. Compared with those huge commercial tools, it is small, flexible and provides many functions. Watir can simulate various operations on IE, such as clicking links, filling forms, clicking buttons and page verification. Watir can be extended to use all Ruby class libraries. In this article, Watir is used to load the dynamic pages of the Internet of Things, and the required page element positioning and other operations are performed.

[0028] 2) Ruby library Nokogiri for HTML / XML

[0029] There are many plugins for Ruby parsing XML and HTML, the most famous of which are Hprico...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method for collecting real-time information on dynamic pages of the Internet of Things. The method is divided into four parts and involves four modules. The four modules are respectively a loading page module, a page HTML module, an HTML module obtained by parsing, and a data storage module. Loading The page module loads the external page through the network link address, and passes the loaded dynamic page to the acquiring HTML module, which acquires the HTML document of the page, and at the same time passes the acquired HTML document to the parsing HTML module, and the parsing HTML module passes the The positioning technology parses the required text content from the obtained HTML document, and transmits the text content to the data storage module for storage. The invention realizes the real-time acquisition and storage of the dynamic information of the Internet of Things entity, and does not need to connect to the database on the server, has good scalability, and can meet the processing requirements of the Internet of Things massive data volume.

Description

technical field [0001] The invention relates to a Watir-based method capable of obtaining entity information of the Internet of Things in real time, and belongs to the technical field of data processing. Background technique [0002] The Internet of Things (Internet Of Things) generally refers to the "Internet of Things Connected". Its core and foundation is the Internet, which is a network that extends and expands on the basis of the Internet, and its client end extends and extends to any item. The Internet of Things connects any item with the Internet for information exchange and communication. With the wide application of embedded sensors in various fields, the Internet of Things technology has been gradually integrated into people's lives. The application of the Internet of Things is very extensive, covering intelligent transportation, environmental protection, warehousing and logistics, public safety, industrial inspection, safe home, etc., almost involving any field ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30
Inventor 孔英会沈丹凤
Owner BEIJING DIWINET TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap