Distributed data computing method, device, computer equipment and readable storage medium

A distributed data and computing method technology, applied in the computer field, can solve problems such as high operation and maintenance costs, performance dependence, and poor scalability, and achieve efficient data computing, good computing performance, and guaranteed data computing effects

Active Publication Date: 2022-06-07
CHINA PING AN LIFE INSURANCE CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Among them, the multi-threaded distributed computing technology has the following problems: 1. Its scalability is poor, and its performance is too dependent on the performance of a single hardware; 2. It is difficult to greatly improve performance, and it is impossible to realize a large number of distributed computing
The distributed computing technology headed by Hadoop has the following problems: 1. It is not completely suitable for processing data calculation as a big data analysis tool; 2. It needs to build a heterogeneous system separately and deploy it separately, and the operation and maintenance cost is high.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed data computing method, device, computer equipment and readable storage medium
  • Distributed data computing method, device, computer equipment and readable storage medium
  • Distributed data computing method, device, computer equipment and readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] The following will be combined with the accompanying drawings in the embodiments of the present invention, the technical solution in the embodiments of the present invention will be described clearly and completely, obviously, the embodiments described are part of the embodiments of the present invention, and not all embodiments. Based on embodiments in the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative work, are within the scope of protection of the present invention.

[0035] It should be understood that, when used in this specification and the appended claims, the terms "comprising" and "comprising" indicate the existence of the features described, the whole, the steps, the operation, the elements and / or components, but does not exclude the existence or addition of one or more other features, wholes, steps, operations, elements, components and / or sets thereof.

[0036] It should also be understood that ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the present invention discloses a distributed data computing method, device, computer equipment, and readable storage medium, wherein the method includes sequentially storing event messages generated according to preset rules in the message queue of the message middleware; according to The first preset rule reads several message events in the message queue in turn and sends them to the Ignite task manager; controls the Ignite task manager to count the number of idle threads of each application server in the server cluster to determine the number of idle threads Most application servers are used as target servers, wherein the server cluster includes several application servers, and each application server includes several threads; the Ignite task manager is controlled to send several message events received to the determined target server, So as to carry out the corresponding data calculation. The present invention can dynamically allocate computing tasks, ensure more efficient use of computing resources, and provide the most efficient computing performance.

Description

Technical field [0001] The present invention relates to the field of computer technology, in particular to a distributed data computing method, apparatus, computer equipment and a readable storage medium. Background [0002] The current commission batch calculation, especially in the insurance industry, is mainly based on distributed computing technology led by multi-threaded or Hadoop. Among them, multi-threaded distributed computing technology has the following problems: 1, its scalability is poor, and its performance is too dependent on the performance of a single hardware; 2. It is difficult to greatly improve performance, and it is impossible to achieve a large number of distributed computing. The distributed computing technology led by Hadoop has the following problems: 1. It is not entirely suitable for processing data computation as a big data analysis tool; 2. It is necessary to build a heterogeneous system separately and deploy it separately, and the operation and maint...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06Q40/08H04L67/1023
CPCH04L67/1023G06Q40/08Y02D10/00
Inventor 周毅
Owner CHINA PING AN LIFE INSURANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap