Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method and system for fetching business data

A business data and data technology, applied in the direction of electronic digital data processing, special data processing applications, instruments, etc., can solve the problems of large resource inability, cost, and acquisition of business data, and achieve the goal of reducing resources, strong applicability, and flexible transplantation Effect

Active Publication Date: 2013-11-20
BEIJING BEWINNER COMM CO LTD +1
View PDF4 Cites 23 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The technical problem to be solved in this application is to provide a business data capture method and system to solve the problem that a large amount of resources are spent on data collection and business data cannot be obtained by configuring relevant information

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and system for fetching business data
  • Method and system for fetching business data
  • Method and system for fetching business data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0035] like figure 1 As shown, it is a flow of a business data capture method described in Embodiment 1 of the present application.

[0036] Step 101 , configuring rule data required for a grabbing operation.

[0037] Further, the rule data includes: resource URI (Uniform Resource Identifier, resource identifier), related codes, capture task trigger data and / or rule template and other data. The rule data after the configuration is completed is stored in the configuration file. Specifically, the rule data may be set by the user according to individual needs, or may be automatically set by the Internet product according to its update status. It should be noted that, in practical applications, the grabbing operation may be implemented by a grabbing module or a grabbing center composed of a processing chip.

[0038] Step 102, read the rule data, establish a webpage resource grabbing task according to the rule data, and store the grabbed webpage resources according to the config...

Embodiment 2

[0050] like figure 2 As shown, it is a business data capture system described in Embodiment 2 of the present application, including: a configuration module 201, a capture processing module 202, an integrity verification module 203, and an early warning module 204; wherein,

[0051] The configuration module 201 is coupled with the grabbing processing module 202, and is configured to configure rule data required for a grabbing operation, and store the configured rule data in a configuration file. The rule data includes: resource URI (Uniform Resource Identifier, resource identifier), related codes, capture task trigger data and / or rule template and other data.

[0052] The capture processing module 202 is coupled with the configuration module 201, the integrity verification module 203 and the early warning module 204, and is used to read the configuration file stored in the configuration module 201 and obtain the rule According to the rule data, a webpage resource grabbing tas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method and a system for fetching business data. The method includes configuring rule data required during fetching operation; reading the rule data, creating web page resource fetching tasks according to the rule data, and storing fetched web page resources according to configuration rules in a classified manner; creating data analysis tasks for the fetched web page resources, analyzing HTML (hypertext markup language) documents for the fetched web page resources to acquire required resource URIs (uniform resource identifiers) and filtering out the resources with incomplete data; creating resource download tasks, and downloading the resource URIs acquired by means of analysis in a breakpoint resume manner to acquire resource data; storing the resource data or fetching other resource data according to the integrity of the resource data and transmitting reporting information if the fetching operation cannot be completed normally. The method and the system have the advantage that problems that large quantities of resources are consumed when data are acquired while business data cannot be acquired by means of configuring relevant information are solved.

Description

technical field [0001] This application relates to the field of data collection, and in particular, relates to a method and system for capturing business data. Background technique [0002] Today, with the rapid development of Internet technology, the huge amount of data and information contained in it has changed the way people obtain information: from the traditional way of looking through books to searching through Internet search engines. Now people are used to obtaining the information they need through the Internet. [0003] At present, various Internet products have emerged to provide people with various convenient and practical functional services on the Internet. The above-mentioned Internet of Things products also obtain business data through the Internet. The accuracy and richness of the data in the products often determine Product life cycle. However, the information obtained through search engines is usually displayed in the form of web pages. Such information...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F17/30
Inventor 李正勇曹东李建涛
Owner BEIJING BEWINNER COMM CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com