Unlock instant, AI-driven research and patent intelligence for your innovation.

Data processing method and device

A technology for data processing and source data, applied in the computer field, can solve problems such as poor timeliness of massive data filtering, save labor costs and overcome poor timeliness

Pending Publication Date: 2021-08-27
BEIJING WODONG TIANJUN INFORMATION TECH CO LTD +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the embodiments of the present invention provide a method and device for data processing, which can solve the problem of poor timeliness in existing massive data filtering

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] Exemplary embodiments of the present invention are described below in conjunction with the accompanying drawings, which include various details of the embodiments of the present invention to facilitate understanding, and they should be regarded as exemplary only. Accordingly, those of ordinary skill in the art will recognize that various changes and modifications of the embodiments described herein can be made without departing from the scope and spirit of the invention. Also, descriptions of well-known functions and constructions are omitted in the following description for clarity and conciseness.

[0032] figure 1 is a schematic diagram of the main flow of the data processing method according to the first embodiment of the present invention, such as figure 1 As shown, the data processing methods include:

[0033] Step S101 , acquiring page configuration content, parsing it into a script string based on page configuration rules, and then loading the script string th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method and device, and relates to the technical field of computers. A specific embodiment of the method comprises the steps of obtaining page configuration content, analyzing the page configuration content into a script character string based on a page configuration rule, and further loading the script character string through a preset user-defined function; reading source data, inputting the source data into a script, executing the script through the self-defined function, and determining whether the source data meet a preset condition or not so as to execute screening of the source data. Therefore, the embodiment of the invention can solve the problem of poor timeliness of existing mass data filtering.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing method and device. Background technique [0002] At present, most of the filtering of massive data is based on Hadoop to realize data processing and filtering under specific rules by writing codes, such as writing MapReduce programs, HIVE scripts, etc. [0003] In the course of realizing the present invention, the inventor finds that there are at least the following problems in the prior art: [0004] When filtering massive data by rules, if the rules change, the code needs to be changed to reimplement the rules. Therefore, in the case of many rules and frequent changes, the requirement of timeliness cannot be met at all. Contents of the invention [0005] In view of this, the embodiments of the present invention provide a data processing method and device, which can solve the problem of poor timeliness in filtering massive data. [0006] In order...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F8/40G06F16/2455G06F16/28
CPCG06F8/40G06F16/283G06F16/24553
Inventor 王海涛
Owner BEIJING WODONG TIANJUN INFORMATION TECH CO LTD