Big data computing method, computing system, computer equipment and readable storage medium

A computing method and computing system technology, applied in the field of big data computing, to achieve the effect of improving efficiency, increasing the number of concurrent, and reducing load

Inactive Publication Date: 2018-03-30
YONYOU FINANCIAL INFORMATION TECH
View PDF8 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The traditional application architecture can no longer meet the application requirements of such a large amount of data and high-density computing

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data computing method, computing system, computer equipment and readable storage medium
  • Big data computing method, computing system, computer equipment and readable storage medium
  • Big data computing method, computing system, computer equipment and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] In order to understand the above-mentioned aspects, features and advantages of the present invention more clearly, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that, in the case of no conflict, the embodiments of the present application and the features in the embodiments can be combined with each other.

[0046] In the following description, many specific details are set forth in order to fully understand the present invention, but the present invention can also be implemented in other ways different from those described here, therefore, the protection scope of the present invention is not limited to the specific details disclosed below. EXAMPLE LIMITATIONS.

[0047] The embodiment of the first aspect of the present invention proposes a big data computing method, figure 1 A schematic flow diagram showing a big data computing method according to an embodiment o...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a big data computing method, a big data computing system, computer equipment and a computer readable storage medium. The big data computing method comprises the steps that to-be-processed tasks are acquired, and a computing job is submitted to a Spark computing engine according to the to-be-processed tasks; the computing job is submitted into a job queue; whether physical resources needed for scheduling the computing job are available in the Spark computing engine is judged; when the physical resources are available in the Spark computing engine, the computing job is scheduled; the computing job is controlled to load computing data, and the computing data is computed to generate a computing result; and the computing result is stored. The method is based on an apportioned computing engine of big data Spark, the advantages of powerful distributed parallel processing and memory computing abilities and quick query of Spark are fully utilized, the parallel quantity ofthe computing tasks is increased, and the efficiency of multidimensional analytical computing is improved.

Description

technical field [0001] The present invention relates to the technical field of big data computing, in particular to a big data computing method, a big data computing system, computer equipment, and a computer-readable storage medium. Background technique [0002] With the deepening of the refined management of financial institutions, it has developed from focusing on the profitability of institutions and departments, business lines and products to focusing on multi-dimensional business data such as account managers, customers, channels, and projects. The allocation of operating costs has been refined from the organization and product dimensions to the allocation of account and transaction-level dimensions. [0003] At the same time, with the refinement of the original voucher data, the allocation rules are diversified. Compared with the original data, the allocation results often increase geometrically, and the resulting data has reached hundreds of millions, or even billion...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/48G06F9/50
CPCG06F9/4843G06F9/5027
Inventor 金锋李长山
Owner YONYOU FINANCIAL INFORMATION TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap