Eureka AIR delivers breakthrough ideas for toughest innovation challenges, trusted by R&D personnel around the world.

Data distribution method and device, electronic equipment and storage medium

A technology for data allocation and to-be-allocated, which is applied in the computer field and can solve problems such as lowering data processing efficiency, uncontrollable data flow, and unbalanced allocation, so as to achieve the effect of improving data processing efficiency and making good use of cluster resources

Pending Publication Date: 2022-01-11
挂号网(杭州)科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the use of existing technologies is prone to uncontrollable data flow allocated by each cluster node, prone to unbalanced allocation, waste of resources, and reduced data processing efficiency

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data distribution method and device, electronic equipment and storage medium
  • Data distribution method and device, electronic equipment and storage medium
  • Data distribution method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0030] figure 1 A flowchart of a data according to allocation of the embodiment of the present invention. The method may be performed by the data distribution apparatus, the apparatus may be implemented by software and / or hardware may be arranged in terminal and / or servers to implement data distribution method in the embodiment of the present invention.

[0031] like figure 1 , The method of the present embodiment may specifically include:

[0032] S101, the received request data to be dispensed, the data acquisition source information request data.

[0033] In a specific embodiment, when receiving a request for data to be dispensed, the data may determine the request source information data. Alternatively, the data acquisition source information request data, comprising: acquiring data corresponding to the request Internetworking Protocol address of the request terminal, the requesting user identifier, requesting at least one terminal identifier and the identifier of the req...

Embodiment 2

[0042] figure 2 Flow diagram of another data distribution method according to an embodiment of the present invention. In this embodiment, the above-described technical solutions as the basis for the optimization. Optionally, before it is determined that the request target cluster node hash key corresponding to the nodes in each cluster, further comprising: obtaining a first node of the current node information of each cluster; each node and the information consistent hashing algorithm, establish a mapping relationship between the hash cluster node with the hash key. Wherein each interpretation identical or corresponding term in the above embodiment are not repeated here.

[0043] like figure 2 , The method of the present embodiment may specifically include:

[0044] S201, the received request data to be dispensed, the data acquisition source information request data.

[0045] S202, data and information sources consistent hashing algorithm, determining that the request data corres...

Embodiment 3

[0060] The specific application scenarios are given below for the embodiments of the data allocation method, and the specific application scenarios are given in order to further understand the technical solutions of the method in order to enable those skilled in the art. The data allocation method of the embodiment of the present invention can be applied to the gateway.

[0061] image 3 A schematic diagram of a data allocation method for a dual network view provided by the embodiment of the present invention; image 3 As shown, the gateway 1 receives the request 1, request 2 and the request 3 request data, separately determines the request 1, request 2, and the user ID of the request 3 (Identity Document, Identity ID). Based on the user ID and consistency hash algorithm, determine the request has a hash key, based on the request hash key and the pre-established hash mapping relationship, the gateway 1 determines that the request is assigned to the cluster 1, will request 2 And req...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention discloses a data distribution method and device, electronic equipment and a storage medium. The method comprises the following steps: receiving to-be-distributed request data, and obtaining data source information of the request data; determining a request hash key corresponding to the request data based on the data source information and a consistent hash algorithm; and based on the request hash key and a pre-established hash mapping relationship between each cluster node and each hash key, determining a target cluster node corresponding to the request hash key in each cluster node, and distributing the request data to the target cluster node. According to the technical scheme provided by the embodiment of the invention, the request data can be allocated through the data source information and the consistent Hash algorithm, the problem of uncontrollable data traffic is solved, cluster resources can be better utilized, and the data processing efficiency can be improved.

Description

Technical field [0001] Embodiments of the present invention relates to computer technology, and in particular relates to a data distribution method, apparatus, electronic apparatus and a storage medium. Background technique [0002] With the rapid expansion of the amount of data, in order to improve the efficiency and capacity of data processing, multi-node cluster on the way of data processing are widely used. [0003] In the prior art, when a cluster node data distribution request, in order to facilitate traceability generally classified data, the same type of data is assigned to the same cluster node, so that when the user accesses certain types of data, a cluster node can access only . For example, according to the requesting user terminal used by different operators, data classification request. However, the prior art prone to traffic distribution nodes in the cluster are not controlled, the situation is prone to imbalance in the distribution, waste of resources, reducing th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/50
CPCG06F9/5027
Inventor 徐霁刘磊
Owner 挂号网(杭州)科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com