Data processing method and device

A data processing and data acquisition technology, applied in the Internet field, can solve the problems of high coupling, weak scalability, and inability to deal with massive data processing in the development system, and achieve the effect of solving high coupling and avoiding repeated processing

Pending Publication Date: 2022-08-09
BANK OF CHINA
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] For overseas branches, the traditional data processing method is to provide them with a unified database by the head office, and each branch processes the required data according to its own needs. Since the data processing requirements of each branch are not very different, this processing method would result in a lot of reprocessing
[0004] In addition, when each overseas branch processes data, the data scripts used include C language and Java. The limitation of using the database itself makes it unable to cope with the processing of massive data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] Embodiments of the present application will be described in more detail below with reference to the accompanying drawings. While certain embodiments of the present application are shown in the drawings, it is to be understood that the present application may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for the purpose of A more thorough and complete understanding of this application. It should be understood that the drawings and embodiments of the present application are only used for exemplary purposes, and are not used to limit the protection scope of the present application.

[0044] see figure 1 As shown, the embodiment of the present application discloses a data processing method, which is applied to a big data platform, and the method includes:

[0045] In a possible implementation, the data processing is implemented on the big data platform. Different from the existing data proc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data processing method and device, and the method comprises the steps: obtaining task parameters of a data processing task based on a corresponding relation between the name of the data processing task and the task parameters of the data processing task; acquiring a data processing script of the data processing task based on a corresponding relationship between the task parameter and the data processing script; judging whether the data processing script contains a common function or not, and if yes, calling the common function corresponding to the data processing script according to the corresponding relation between the data processing script and the common function; embedding the common function into a corresponding position of a data processing script corresponding to the common function; based on the name of the data processing task, obtaining a sequence of the task parameters; based on the sorting of the task parameters, obtaining an execution sequence of the data processing scripts; under a big data program framework, executing the data processing script according to the execution sequence; and generating a task report template of the data processing task.

Description

technical field [0001] The present application relates to the field of Internet technologies, and in particular, to a data processing method and device. Background technique [0002] Due to the large number of business types and customer data, for ease of use and analysis, processing data into data reports is a common method used by banks. [0003] For overseas branches, the traditional data processing method is that the head office provides them with a unified database, and each branch processes the required data according to its own needs. This will lead to a lot of repetitive processing. [0004] In addition, the data scripts used by overseas branches include C language and Java when processing data. The processing process requires a large number of stored procedures to implement, resulting in high coupling and weak scalability of the development system. The limitation of using the database itself makes it unable to cope with the processing of massive data. SUMMARY OF...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/27G06F16/21
CPCG06F16/254G06F16/27G06F16/211
Inventor 唐琳李成伟林春萍钱家欣
Owner BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap