Distributed data computing method, device, computer equipment and readable storage medium

A technology of distributed data and computing methods, applied in the computer field, can solve problems such as performance dependence, high operation and maintenance costs, and poor scalability, and achieve good computing performance, efficient data computing, and guaranteed data computing effects

Active Publication Date: 2018-11-09
CHINA PING AN LIFE INSURANCE CO LTD
View PDF5 Cites 16 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, the multi-threaded distributed computing technology has the following problems: 1. Its scalability is poor, and its performance is too dependent on the performance of a single hardware; 2. It is difficult to greatly improve performance, and it is impossible to realize a large number of distributed computing
The distributed computing technology headed by Hadoop has the following problems: 1. It is not completely suitable for processing data calculation as a big data analysis tool; 2. It needs to build a heterogeneous system separately and deploy it separately, and the operation and maintenance cost is high.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data computing method, device, computer equipment and readable storage medium
  • Distributed data computing method, device, computer equipment and readable storage medium
  • Distributed data computing method, device, computer equipment and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are some of the embodiments of the present invention, but not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0035] It should be understood that when used in this specification and the appended claims, the terms "comprising" and "comprises" indicate the presence of described features, integers, steps, operations, elements and / or components, but do not exclude one or Presence or addition of multiple other features, integers, steps, operations, elements, components and / or collections thereof.

[0036] It should also be understood that the terminology used ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a distributed data computing method, device, computer equipment and a readable storage medium. The method comprises steps: event messages generated accordingto preset rules are sequentially stored in a message queue of a message middleware; according to a first preset rule, a plurality of message events in the message queue are read sequentially and are transmitted to an Ignite task manager; the Ignite task manager is controlled to count the number of idle threads in each application server in a server cluster, so as to determine the application server with the maximum idle threads as a target server, wherein the server cluster comprises a plurality of application servers, and each application server comprises a plurality of threads; and the Ignite task manager is controlled to transmit the plurality of received message events to the determined target server to perform corresponding data calculation. Computing tasks can be dynamically allocated, computing resources are ensured to be used more efficiently, and the most efficient computing performance is provided.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a distributed data computing method, device, computer equipment and readable storage medium. Background technique [0002] The current batch calculation of commissions, especially the data calculation in the insurance industry, is mainly based on distributed computing technology led by multi-threading or Hadoop. Among them, the multi-threaded distributed computing technology has the following problems: 1. Its scalability is poor, and its performance is too dependent on the performance of a single hardware; 2. It is difficult to greatly improve the performance, and it is impossible to realize a large number of distributed computing. The distributed computing technology led by Hadoop has the following problems: 1. It is not completely suitable for processing data calculation as a big data analysis tool; 2. It needs to build a heterogeneous system separately, deploy it sep...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06Q40/08H04L29/08
CPCH04L67/1023G06Q40/08Y02D10/00
Inventor 周毅
Owner CHINA PING AN LIFE INSURANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap