Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Data processing method and data processing system

A data processing and metadata technology, applied in the computer field, can solve the problem of low computing efficiency of data architecture, and achieve the effect of avoiding storage burden, improving computing efficiency, and reducing scheduling.

Active Publication Date: 2019-09-20
WEBANK (CHINA)
View PDF6 Cites 10 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] The embodiment of the present application provides a data processing method and a data processing system, which are used to solve the problem of low computational efficiency of the existing data architecture

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and data processing system
  • Data processing method and data processing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0019] In order to make the purposes, technical solutions and advantages of the embodiments of the present application clearer, the technical solutions of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are the embodiment of the present invention Some embodiments of the technical solution, but not all embodiments. Based on the embodiments described in the present application documents, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the technical solution of the present invention.

[0020] The terms "first" and "second" in the specification and claims of the present application and the above drawings are used to distinguish different objects, rather than to describe a specific order. Furthermore, the term "comprises", as well as any variations th...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data processing method and a data processing system, and relates to the technical field of computers. The method comprises the following steps that after a target scheduling node in a scheduling cluster obtains a data processing request for calling an API interface, according to a preset scheduling rule, a target execution node is determined according to metadata of target data requested to be processed in the data processing request, wherein the target execution node is used for receiving the data processing request and scheduling the data processing request to the determined target execution node, and the target execution node processes the target data according to the data processing request after receiving the data processing request so as to obtain a data processing result and return the obtained data processing result to the scheduling cluster. Therefore, for all data processing requests (such as calculation requests and storage requests) aiming at the same data, the same scheduling rule is adopted, so that localization of calculation and storage can be absolutely ensured, data scheduling can be reduced as much as possible, and the calculation efficiency is improved.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a data processing method and a data processing system. Background technique [0002] With the development of computer technology, more and more technologies are applied in the financial field, and the traditional financial industry is gradually transforming into Fintech. However, due to the security and real-time requirements of the financial industry, higher requirements are placed on technology. requirements. The financial industry (such as banks) generally involves the processing of large amounts of financial data, so the financial industry has higher requirements for the distributed infrastructure used. [0003] At present, the more commonly used distributed infrastructures include Apache Hadoop MapReduce, Apache Spark, Apache Flink, etc. These distributed infrastructure platforms use software technology and combine hardware to aggregate separate computing power to...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5027G06F9/5061Y02D10/00
Inventor 张潮宇黄铭毅陈江枫陈天健
Owner WEBANK (CHINA)
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com