Supercharge Your Innovation With Domain-Expert AI Agents!

Data processing method and device, terminal equipment and storage medium

A data processing and database technology, applied in the field of big data, can solve the problem of not making full use of server resources, and achieve the effect of maximizing utilization

Pending Publication Date: 2021-04-09
ONE CONNECT SMART TECH CO LTD SHENZHEN
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The embodiment of the present application provides a data processing method, device, terminal equipment, and storage medium, which can solve the problem that server resources cannot be fully utilized when a large amount of data is sent to multiple servers for processing.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device, terminal equipment and storage medium
  • Data processing method and device, terminal equipment and storage medium
  • Data processing method and device, terminal equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present application. It will be apparent, however, to one skilled in the art that the present application may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present application with unnecessary detail.

[0055] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude one or more other Presence or addition of features, wholes, steps, operations, elements, components and / or collections thereof.

[0056] It should...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention is suitable for the technical field of big data, and provides a data processing method and device, terminal equipment and a storage medium, and the method comprises the steps: transmitting a plurality of preset data extraction rules to a plurality of message partitions in a message queue; obtaining data IDs of a plurality of pieces of to-be-processed data in a database; for any message partition, extracting to-be-processed data from a database according to the data extraction rule and the data ID through a sub-node server; when the sub-node server has a fault, determining an unexecuted data extraction rule in the fault message partition; and according to a re-balance strategy, respectively allocating the unexecuted data extraction rules to the message partitions corresponding to the sub-node servers in the normal state. By adopting the method, when the sub-node server sends a fault, the unexecuted data extraction rule in the fault message partition corresponding to the sub-node server is redistributed according to the re-balance strategy, so that the purpose of maximizing the utilization of server resources is achieved.

Description

technical field [0001] The present application belongs to the technical field of big data, and in particular relates to a data processing method, device, terminal equipment and storage medium. Background technique [0002] In the prior art, a distributed data processing system is usually used to perform large-scale data processing. However, in the existing distributed data processing system, if the distributed data processing system directly distributes all the data to be processed to each server, the processing pressure of each server in the distributed data processing system will be increased. If the data is divided into multiple parts and sent to each server separately, the data size distribution of each part is not uniform, or the processing performance of the servers is different, which will cause the problem that the server resources cannot be fully utilized. Contents of the invention [0003] The embodiments of the present application provide a data processing meth...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/54G06F16/27
CPCG06F9/546G06F16/27G06F2209/548
Inventor 刘根生
Owner ONE CONNECT SMART TECH CO LTD SHENZHEN
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com