A method, device, equipment and storage medium for optimizing snowflake algorithm

Abstract

The present invention discloses a method, device, equipment and storage medium for optimizing a snowflake algorithm, the method comprising: obtaining a service request for generating a unique target ID; obtaining a time difference according to the service request; automatically configuring a feature part according to the service request; generating a unique target ID based on the time difference and the feature part. The technical solution of the present invention optimizes the snowflake algorithm, automatically obtains the MAC address of the target server, does not require manual parameter transmission by staff, reduces the complexity of development work, and realizes the generation of a unique ID for a cloud-based distributed system; and can control the length of the distributed target ID by configuring the length of the auto-increment sequence number according to the service concurrency.

Description

Technical Field

[0001] The present invention belongs to the field of computer technology, and in particular relates to a method, device, equipment and storage medium for optimizing a snowflake algorithm. Background Art

[0002] In the current algorithm that uses the snowflake algorithm to generate distributed unique IDs, in order to avoid duplicate IDs generated by distributed services at the same time, the work machine ID needs to be manually obtained by the developer, which increases the development workload; moreover, if different developers pass in the same work machine ID at the same time (duplicate IP in different domains), the unique ID is at risk of being duplicated.

[0003] In addition, when the server receives multiple service requests at the same time and needs to generate multiple unique IDs, duplication is avoided by using a self-incrementing serial number with the last few digits. However, if the self-incrementing serial number is too short, the service cannot be provided normally when the service concurrency is very high. If the self-incrementing serial number is too long, if the concurrency is not high, it will result in a waste of digits and the unique ID will be too long. Summary of the invention

[0004] The present invention aims to solve one of the technical problems in the related art at least to a certain extent. To this end, one object of the present invention is to provide a method, device, equipment and storage medium for optimizing a snowflake algorithm.

[0005] In order to solve the above technical problems, the embodiments of the present invention provide the following technical solutions:

[0006] A method for optimizing a snowflake algorithm, comprising:

[0007] Get a service request to generate a unique target ID;

[0008] According to the service request, obtaining a time difference;

[0009] automatically configuring a feature portion according to the service request;

[0010] Based on the time difference and the characteristic portion, a unique target ID is generated.

[0011] Optionally, obtaining the time difference according to the service request includes:

[0012] Preset base timestamp;

[0013] Get the current timestamp;

[0014] The difference between the current timestamp and the reference timestamp is calculated to obtain the time difference; wherein the time difference is in seconds or milliseconds.

[0015] Optionally, automatically configuring a feature part according to the service request includes:

[0016] The target server receives the service request;

[0017] The target server generates a MAC address according to the service request;

[0018] The configuration module obtains the number N of service requests received by each target server at the same time;

[0019] If N is equal to 1, the configuration module does not configure the auto-increment sequence number;

[0020] If N is greater than 1, the configuration module configures the self-incrementing sequence number.

[0021] Optionally, if N is greater than 1, the configuration module configures the self-incrementing sequence number, including:

[0022] Preset the threshold value of N;

[0023] If N is less than or equal to the threshold, the configuration module configures a first self-incrementing sequence number;

[0024] If N is greater than the threshold, the configuration module configures a second self-incrementing sequence number.

[0025] Optionally, the number of bits of the first self-incrementing sequence number is smaller than that of the second self-incrementing sequence number.

[0026] Optionally, generating a unique target ID based on the time difference and the characteristic part includes:

[0027] Based on binary, the time difference and the characteristic part are converted into a binary timestamp, a binary MAC address and a binary self-incrementing sequence number in sequence;

[0028] The binary timestamp, the binary MAC address and the binary self-incrementing serial number are sequentially connected to generate a unique target ID.

[0029] Optionally, the binary timestamp includes 31 bits, the binary MAC address includes 10 bits, and the binary self-incrementing sequence number includes 0 to 6 bits.

[0030] An embodiment of the present invention further provides a device for optimizing a snowflake algorithm, comprising:

[0031] An acquisition module, used to obtain a service request for generating a unique target ID;

[0032] A calculation module, used for obtaining a time difference according to the service request;

[0033] A configuration module, used for automatically configuring a feature part according to the service request;

[0034] A generating module is used to generate a unique target ID based on the time difference and the characteristic part.

[0035] An embodiment of the present invention further provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above method when executing the computer program.

[0036] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, and the computer program implements the above method when executed by a processor.

[0037] The embodiments of the present invention have the following technical effects:

[0038] The above technical solution of the present invention 1) optimizes the snowflake algorithm, automatically obtains the MAC address of the target server, and does not require manual parameter transmission by staff, thereby reducing the complexity of development work and generating a unique ID for a cloud-based distributed system.

[0039] 2) Provide a globally unique ID for other services in the cluster as an independent service, and control the length of the distributed target ID by configuring the length of the auto-increment sequence number according to the service concurrency. When the number of distributed target IDs generated per unit time is large, the length of the auto-increment sequence number can be increased; otherwise, it can be shortened to avoid too long a number of digits when displaying the page, saving the storage capacity of the distributed system and improving the running speed of the distributed system.

[0040] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] Figure 1 It is a flowchart of a method for optimizing a snowflake algorithm provided by an embodiment of the present invention;

[0042] Figure 2 is a block diagram of a method for optimizing a snowflake algorithm provided by an embodiment of the present invention;

[0043] Figure 3 is a schematic diagram of the structure of a target ID provided by an embodiment of the present invention;

[0044] Figure 4 It is a structural schematic diagram of a device for optimizing a snowflake algorithm provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0045] Embodiments of the present invention are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present invention, and should not be construed as limiting the present invention.

[0046] The MAC address mentioned in the present invention: physical address and local area network address; ID (Identity document), identity card identification number.

[0047] like Figure 1 As shown, an embodiment of the present invention provides a method for optimizing a snowflake algorithm, comprising:

[0048] Step S1: Obtain a service request for generating a unique target ID;

[0049] Specifically, the distributed system obtains a service request for generating a unique target ID and performs processing based on the received service request.

[0050] Step S2: Obtaining a time difference according to the service request;

[0051] Specifically, according to the received service request, the corresponding node of the distributed system calculates the time difference according to the current timestamp of the node and the reference timestamp; the time difference can be sorted according to time to facilitate query and improve query efficiency.

[0052] Step S3: automatically configuring a feature part according to the service request;

[0053] Specifically, the distributed system sends the received service requests to the corresponding target server. In actual applications, the same target server may receive multiple service requests at the same time, which may include account identification, order processing, etc. In order to avoid duplication of the generated target ID, the target server generates a feature part after the time difference, so that the generated target ID is unique and has practical application value.

[0054] Step S4: Generate a unique target ID based on the time difference and the characteristic part.

[0055] This embodiment of the present invention optimizes the snowflake algorithm, automatically obtains the MAC address of the target server, and does not require manual parameter transmission by staff, thereby reducing the complexity of development work and enabling generation of a unique ID for a cloud-based distributed system;

[0056] Among them, the distributed system refers to the servers supporting services, resource servers, etc., which are located on different nodes of the distributed system. In a complex distributed system, based on different service requests, it is necessary to generate a unique target ID for distinction to prevent the distributed system from not being able to work properly.

[0057] In an optional embodiment of the present invention, in step S2, obtaining the time difference according to the service request includes:

[0058] Step S21: preset a reference timestamp;

[0059] Specifically, in order to obtain the time difference item in the unique target ID, a reference timestamp is first preset; wherein the reference timestamp can be preset according to actual needs, and in order to avoid the target ID being too long, the reference timestamp is as close to the current time as possible;

[0060] For example: the current time is 2021 / 7 / 20, and the benchmark time can be 2021 / 1 / 1.

[0061] Step S22: Get the current timestamp;

[0062] Specifically, it is automatically obtained by the distributed system according to the time when the service request is triggered.

[0063] Step S23: Calculate the difference between the current timestamp and the reference timestamp to obtain the time difference; wherein the time difference is in seconds or milliseconds.

[0064] Specifically, the unit of the time difference is determined according to the actual business. If the distributed system has a high concurrency of services at the same time, milliseconds are used as the unit. If the service concurrency is low, seconds are used as the unit.

[0065] In an optional embodiment of the present invention, in step S3, automatically configuring the feature part according to the service request includes:

[0066] Step S31: The target server receives the service request;

[0067] Step S32: the target server generates a MAC address according to the service request;

[0068] Specifically, in order to avoid duplication of generated target IDs, when the target server receives a request to obtain a working machine ID (including a data center ID and a working node ID), it generates its own MAC address based on the uniqueness of its own MAC address to avoid duplication of target IDs generated by other target servers.

[0069] Step S33: the configuration module obtains the number N of service requests received by each target server at the same time;

[0070] Specifically, a target server may receive two or more service requests at the same time. In order to avoid the target server generating duplicate target IDs at this time, the number N of service requests received by the target server at the same time will be counted, and the target server will generate N MAC addresses.

[0071] Step S34: If N is equal to 1, the configuration module does not configure the auto-increment sequence number;

[0072] Step S35: If N is greater than 1, the configuration module configures the self-incrementing sequence number.

[0073] Specifically, the auto-increment sequence number can generate multiple sequence numbers based on the same target server at the same time;

[0074] If N is greater than 1, the configuration module generates N self-incrementing serial numbers corresponding to the N MAC addresses, so as to distinguish the generated N target IDs and ensure that the generated N target IDs are unique.

[0075] This embodiment of the present invention can ensure the uniqueness of multiple target IDs generated by the same target server in response to multiple service requests at the same time by configuring a self-incrementing sequence number.

[0076] In an optional embodiment of the present invention, in step S35, if N is greater than 1, the configuration module configures the self-incrementing sequence number, including:

[0077] Step S351: preset a threshold value of N;

[0078] Specifically, the effective range of the threshold can be set or modified according to actual business.

[0079] Step S352: If N is less than or equal to the threshold, the configuration module configures a first self-incrementing sequence number;

[0080] Specifically, the number of bits of the first self-incrementing sequence number may be 1-3.

[0081] Step S353: If N is greater than the threshold, the configuration module configures a second self-incrementing sequence number.

[0082] Specifically, the number of bits of the first self-incrementing sequence number may be 4 to 6.

[0083] In this embodiment of the present invention, in order to achieve efficient use of the self-incrementing sequence number, a threshold value of N is set to control the length of the target ID, while saving storage space.

[0084] In an optional embodiment of the present invention, in step S35, the number of bits of the first self-incrementing sequence number is smaller than that of the second self-incrementing sequence number.

[0085] This embodiment of the present invention realizes the degree of controlling the target ID by controlling the length of the self-incrementing sequence number, avoiding the waste of bits of the self-incrementing sequence number and the problem that the self-incrementing sequence number is too short, resulting in the inability to provide normal services when the service concurrency is very high.

[0086] In an optional embodiment of the present invention, in step S4, generating a unique target ID based on the time difference and the characteristic part includes:

[0087] Step S41: Based on binary, the time difference and the characteristic part are converted into a binary timestamp, a binary MAC address and a binary self-incrementing sequence number in sequence;

[0088] Specifically, in order to enable the generated time difference and characteristic part to be recognized by a computer, etc., after the task is completed, the time difference and characteristic part need to be converted into binary data.

[0089] Step S42: Concatenate the binary timestamp, binary MAC address and binary auto-increment serial number in sequence to generate a unique target ID.

[0090] In this embodiment of the present invention, the binary MAC address avoids the generation of duplicate target IDs by different target servers, and the binary self-incrementing serial number avoids the problem of duplication of multiple target IDs generated by the same target server at the same time.

[0091] In an optional embodiment of the present invention, in step S41, the binary timestamp includes 31 bits, the binary MAC address includes 10 bits, and the binary self-incrementing sequence number includes 0 to 6 bits.

[0092] Specifically, the number of bits of the binary auto-increment serial number can be automatically matched and set based on the service concurrency through the configuration module, so as to ensure the uniqueness of the generated target ID, improve the utilization rate of the bits of the auto-increment serial number, and improve the operating rate of the distributed system.

[0093] Specific, combined Figure 3 The above embodiments of the present invention can be implemented by the following implementation methods:

[0094] In a distributed system, based on a service request, such as order processing, a unique target ID needs to be generated for the order contained in the service request;

[0095] Calculate time difference: calculate the time difference between the base timestamp and the current timestamp;

[0096] Get MAC address: The target server that receives the service request generates a MAC address;

[0097] The target server generates a corresponding number of different self-incrementing sequence numbers according to the number N of service requests received at the same time;

[0098] The time difference, MAC address and auto-increment serial number generated above are converted into binary and connected in sequence to generate the following Figure 3 Take N unique target IDs as an example; among them, the binary timestamp is 31 bits, the binary MAC address is 10 bits, and the binary auto-increment sequence number is 6 bits.

[0099] like Figure 4 As shown, an embodiment of the present invention further provides a device 400 for optimizing a snowflake algorithm, comprising:

[0100] Acquisition module 401, used to acquire a service request for generating a unique target ID;

[0101] A calculation module 402, configured to obtain a time difference according to the service request;

[0102] Configuration module 403, used for automatically configuring the feature part according to the service request;

[0103] The generating module 404 is used to generate a unique target ID based on the time difference and the characteristic part.

[0104] Optionally, obtaining the time difference according to the service request includes:

[0105] Preset base timestamp;

[0106] Get the current timestamp;

[0107] The difference between the current timestamp and the reference timestamp is calculated to obtain the time difference; wherein the time difference is in seconds or milliseconds.

[0108] Optionally, obtaining the time difference according to the service request includes:

[0109] Preset base timestamp;

[0110] Get the current timestamp;

[0111] The difference between the current timestamp and the reference timestamp is calculated to obtain the time difference; wherein the time difference is in seconds or milliseconds.

[0112] Optionally, automatically configuring a feature part according to the service request includes:

[0113] The target server receives the service request;

[0114] The target server generates a MAC address according to the service request;

[0115] The configuration module obtains the number N of service requests received by each target server at the same time;

[0116] If N is equal to 1, the configuration module does not configure the auto-increment sequence number;

[0117] If N is greater than 1, the configuration module configures the self-incrementing sequence number.

[0118] Optionally, if N is greater than 1, the configuration module configures the self-incrementing sequence number, including:

[0119] Preset the threshold value of N;

[0120] If N is less than or equal to the threshold, the configuration module configures a first self-incrementing sequence number;

[0121] If N is greater than the threshold, the configuration module configures a second self-incrementing sequence number.

[0122] Optionally, the number of bits of the first self-incrementing sequence number is smaller than that of the second self-incrementing sequence number.

[0123] Optionally, generating a unique target ID based on the time difference and the characteristic part includes:

[0124] Based on binary, the time difference and the characteristic part are converted into a binary timestamp, a binary MAC address and a binary self-incrementing sequence number in sequence;

[0125] The binary timestamp, the binary MAC address and the binary self-incrementing serial number are sequentially connected to generate a unique target ID.

[0126] Optionally, the binary timestamp includes 31 bits, the binary MAC address includes 10 bits, and the binary self-incrementing sequence number includes 0 to 6 bits.

[0127] An embodiment of the present invention further provides a computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the above method when executing the computer program.

[0128] An embodiment of the present invention further provides a computer-readable storage medium having a computer program stored thereon, and the computer program implements the above method when executed by a processor.

[0129] In addition, other structures and functions of the device in the embodiment of the present invention are known to those skilled in the art and will not be described herein in detail to reduce redundancy.

[0130] It should be noted that the logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection portion with one or more wirings (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), an optical fiber device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0131] It should be understood that the various parts of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, a plurality of steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0132] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "examples", "specific examples", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0133] In the description of the present invention, it is to be understood that the terms “center”, “longitudinal”, “lateral”, “length”, “width”, “thickness”, “up”, “down”, “front”, “back”, “left”, “right”, “vertical”, “horizontal”, “top”, “bottom”, “inside”, “outside”, “clockwise”, “counterclockwise”, “axial”, “radial”, “circumferential”, etc., indicating orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, are only for the convenience of describing the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as limiting the present invention.

[0134] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of the present invention, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0135] In the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0136] In the present invention, unless otherwise clearly specified and limited, a first feature being "above" or "below" a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being "above", "above" or "above" a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being "below", "below" or "below" a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.

[0137] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may change, modify, replace and vary the above embodiments within the scope of the present invention.

Claims

1. A method for optimizing a snowflake algorithm, characterized in that: include: Get a service request to generate a unique target ID; According to the service request, obtaining a time difference; automatically configuring a feature portion according to the service request; Based on the time difference and the characteristic portion, generate a unique target ID; The automatic configuration feature part according to the service request includes: the target server receives the service request; the target server generates a MAC address according to the service request; the configuration module obtains the number N of service requests received by each target server at the same time; if N is equal to 1, the configuration module does not configure the self-incrementing sequence number; if N is greater than 1, the configuration module configures the self-incrementing sequence number; If N is greater than 1, the configuration module configures the self-incrementing sequence number, including: presetting a threshold of N; if N is less than or equal to the threshold, the configuration module configures a first self-incrementing sequence number; if N is greater than the threshold, the configuration module configures a second self-incrementing sequence number; Based on the time difference and the characteristic part, a unique target ID is generated, including: based on binary, converting the time difference and the characteristic part into a binary timestamp, a binary MAC address and a binary self-incrementing serial number in sequence; connecting the binary timestamp, the binary MAC address and the binary self-incrementing serial number in sequence to generate a unique target ID; The binary timestamp includes 31 bits, the binary MAC address includes 10 bits, and the binary self-incrementing sequence number includes 0 to 6 bits.

2. The method according to claim 1, characterized in that The obtaining of the time difference according to the service request includes: Preset base timestamp; Get the current timestamp; The difference between the current timestamp and the reference timestamp is calculated to obtain the time difference; wherein the time difference is in seconds or milliseconds.

3. The method according to claim 1, characterized in that The number of bits of the first self-incrementing sequence number is smaller than that of the second self-incrementing sequence number.

4. A device for optimizing a snowflake algorithm, characterized in that: include: An acquisition module, used to obtain a service request for generating a unique target ID; A calculation module, used for obtaining a time difference according to the service request; A configuration module, used for automatically configuring a feature part according to the service request; A generating module, used for generating a unique target ID based on the time difference and the characteristic part; The automatic configuration of the characteristic part according to the service request includes: the target server receives the service request; the target server generates a MAC address according to the service request; the configuration module obtains the number N of service requests received by each target server at the same time; if N is equal to 1, the configuration module does not configure the self-incrementing sequence number; if N is greater than 1, the configuration module configures the self-incrementing sequence number; If N is greater than 1, the configuration module configures the self-incrementing sequence number, including: presetting a threshold of N; if N is less than or equal to the threshold, the configuration module configures a first self-incrementing sequence number; if N is greater than the threshold, the configuration module configures a second self-incrementing sequence number; Based on the time difference and the characteristic part, a unique target ID is generated, including: based on binary, converting the time difference and the characteristic part into a binary timestamp, a binary MAC address and a binary self-incrementing serial number in sequence; connecting the binary timestamp, the binary MAC address and the binary self-incrementing serial number in sequence to generate a unique target ID; The binary timestamp includes 31 bits, the binary MAC address includes 10 bits, and the binary self-incrementing sequence number includes 0 to 6 bits.

5. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 3 is implemented.

6. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 3 is implemented.

Images