Non-uniform storage medium data encoding and decoding method and system based on symbol bias

Abstract

The application provides a non-uniform storage medium data coding and decoding method and system based on symbol preference, comprising: using an encoding algorithm and a decoding algorithm to encode and decode a biased non-uniform storage medium, wherein a conversion device and a threshold selection algorithm core component are contained. The encoding algorithm completes the encoding of converting an arbitrary biased mixed-radix data stream to another arbitrary biased mixed-radix data stream, the decoding algorithm completes the inverse operation of encoding transposition, and decodes the encoded data back to the original data stream. The conversion device is responsible for the conversion work in the algorithm, and the threshold selection algorithm ensures the normal operation of the conversion device. Through the efficient streaming data coding and decoding algorithm, the application effectively solves the problem of low efficiency caused by using the traditional data storage method on the non-uniform storage medium, fully utilizes the storage space of the non-uniform storage medium, and realizes more efficient and more reliable data storage.

Description

Technical Field

[0001] This invention relates to the field of data processing technology, and in particular to a data encoding and decoding method and system based on symbol preference in non-uniform storage media. Background Technology

[0002] With the advent of the era of massive data storage, data output will reach the ZB level, posing challenges to the current generation of storage media and the copying and transmission of massive amounts of data.

[0003] Deoxyribonucleic acid (DNA) storage technology possesses the capability to store digital information. Using DNA as the storage medium offers advantages such as high efficiency, large storage capacity, long storage time, and ease of access. However, DNA information storage also presents challenges, such as high storage costs and slow retrieval speeds, which limit its widespread adoption and development in practical applications. To improve the efficiency and reliability of DNA information storage, entropy coding algorithms have gradually become a focus of research. Entropy coding is a type of lossless compression algorithm that reduces data storage volume by utilizing statistical patterns, thereby achieving more efficient storage. Therefore, an increasing number of researchers are exploring the application of entropy coding algorithms to information storage in non-uniform storage media such as DNA, and have conducted related experiments and research. By optimizing and improving entropy coding algorithms, more efficient and reliable data storage can be achieved in non-uniform media information storage, giving it broader application prospects. However, traditional entropy coding algorithms have low computational efficiency, with a computational complexity of O(n^2). 2 This makes it difficult to meet the needs of large-scale real-time data storage, and it cannot achieve efficient storage on this type of non-uniform medium. At the same time, existing entropy coding algorithms cannot complete the conversion of biased mixed-base data to biased mixed-base data, which makes it impossible to fully utilize storage space when some storage media are not only mixed-base but also have uneven symbol distribution in each base.

[0004] Therefore, new encoding and decoding methods for biased mixed-base data are needed. Summary of the Invention

[0005] This invention provides a data encoding and decoding method and system based on symbol preference for non-uniform storage media, which solves the defects in the existing technology for encoding and decoding biased mixed base data.

[0006] In a first aspect, the present invention provides a data encoding and decoding method for non-uniform storage media based on symbol preference, comprising:

[0007] Obtain a mixed-base data stream of a determined length to be encoded with sign preference, wherein each position of the mixed-base data stream of a determined length to be encoded includes base size, base distribution, and sign size;

[0008] A threshold selection algorithm is used to calculate the set of optional threshold parameters for the conversion device. Encoding and decoding threshold parameters are selected from the set of optional threshold parameters, and the intermediate radix size is determined. The conversion device is initialized based on the encoding and decoding threshold parameters and the intermediate radix size.

[0009] The conversion device is turned on, and the push algorithm and pop algorithm are repeatedly applied to the mixed base data stream of a certain length to be encoded until the mixed base data stream of a certain length to be encoded is completely pushed on. The conversion device is turned off, and the pop algorithm is repeatedly applied to the mixed base data stream of a certain length to be encoded until the mixed base data stream of a certain length to be encoded is completely popped, and the encoded data stream is output.

[0010] Following the reverse order of encoding, the conversion device is turned on, and the push-in algorithm and pop-out algorithm are repeatedly applied to the encoded data stream until the encoded data stream is completely pushed in. Then, the conversion device is turned off, and the pop-out algorithm is repeatedly applied to the encoded data stream until the encoded data stream is completely popped out. Finally, the decoded original data is output.

[0011] The push algorithm includes an absorption algorithm, the pop algorithm includes a release algorithm, and both the absorption algorithm and the release algorithm include a reordering algorithm, which is controlled by a first threshold parameter and a second threshold parameter.

[0012] According to the present invention, a data encoding and decoding method for non-uniform storage media based on symbol preference is provided, wherein the reordering algorithm includes:

[0013] Determine the number system size and integer distribution of the data stream;

[0014] Traverse the symbol values ​​of all bases in ascending order. Based on the distribution value of each symbol integer, traverse each symbol value from 0 to the distribution value of each symbol integer minus 1. Use the distribution value of each symbol integer as the x-axis and 0 to the distribution value of each symbol integer minus 1 as the y-axis to obtain the set of all points of all symbol values.

[0015] Sort all points with all symbol values ​​in ascending order using the ordinate as the first key and the abscissa as the second key, to obtain a sorted sequence of point sets.

[0016] According to the present invention, a data encoding and decoding method for non-uniform storage media based on symbol preference is provided, wherein the threshold selection algorithm includes:

[0017] Input integers from multiple bases, distributed across different values;

[0018] Calculate the sum of the distribution values ​​of each signed integer in each number base;

[0019] The available threshold for determining any set of number base distributions is the common multiple of all sums;

[0020] Correspondingly, the threshold selection algorithm is used to calculate all bases and their distributions in the input stream to obtain a set of optional parameters for the first threshold parameter;

[0021] The threshold selection algorithm is used to calculate all bases and their distributions in the output stream to obtain the set of optional parameters for the second threshold parameter.

[0022] According to the present invention, a data encoding and decoding method for non-uniform storage media based on symbol preference is provided, wherein the absorption algorithm includes:

[0023] Input intermediate values, number base, number base distribution, and sign value;

[0024] The reordering algorithm is used to calculate the base size and the base distribution to obtain a point set sequence;

[0025] Sum all the distributed digits in the current base to obtain the sum of the integer distribution values ​​in the current base;

[0026] Calculate the quotient and remainder when the intermediate quantity is divided by the integer value of the distribution corresponding to the sign size;

[0027] The distribution position of the point set sequence is obtained by using the sign size as the x-axis and the remainder as the y-axis;

[0028] Multiply the quotient by the sum of the integer distributions, and add the distribution position of the point set sequence to obtain a new intermediate quantity.

[0029] According to the present invention, a data encoding and decoding method for non-uniform storage media based on symbol preference is provided, wherein the release algorithm includes;

[0030] Input intermediate values, number base, number base distribution, and sign value;

[0031] The reordering algorithm is used to calculate the base size and the base distribution to obtain a point set sequence;

[0032] Sum all the distributed digits in the current base to obtain the sum of the integer distribution values ​​in the current base;

[0033] Calculate the quotient and remainder when the intermediate quantity is divided by the sum of the integer distributions;

[0034] Find the corresponding position point and its x and y coordinates in the point set sequence based on the remainder;

[0035] Multiply the quotient by the integer value of the distribution corresponding to the horizontal axis, and add it to the vertical axis to obtain a new intermediate quantity, and use the horizontal axis as the sign value.

[0036] According to the present invention, a data encoding and decoding method for non-uniform storage media based on symbol preference is provided, wherein the push-in algorithm includes:

[0037] Step 1.1: Input the symbol size, number base, and number base distribution to be pushed;

[0038] Step 1.2: Use the absorption algorithm to calculate the first intermediate quantity, sign size, base size, and base distribution to obtain a new first intermediate quantity;

[0039] Step 1.3: Determine whether the new first intermediate quantity is less than the intermediate quantity base size multiplied by the first threshold parameter. If so, proceed to step 1.7.

[0040] Step 1.4: Determine if the intermediate transition value is empty. If so, proceed to step 1.8.

[0041] Step 1.5: Determine whether the second intermediate quantity is less than the second threshold parameter. If so, proceed to step 1.9.

[0042] Step 1.6: If the push operation fails, proceed to the pop operation, and the algorithm ends.

[0043] Step 1.7: The push operation is successfully performed by replacing the current first intermediate value with the new first intermediate value, and the algorithm ends.

[0044] Step 1.8: Divide the current first intermediate quantity by the size of the intermediate quantity base to obtain the first intermediate quantity, and divide the current first intermediate quantity by the size of the intermediate quantity base to obtain the intermediate quantity transition value, then proceed to step 1.2;

[0045] Step 1.9: Increase the value of the second intermediate quantity and decrease the intermediate quantity transition value, then proceed to step 1.2.

[0046] According to the present invention, a data encoding and decoding method for non-uniform storage media based on symbol preference is provided, wherein the pop-up algorithm includes:

[0047] Step 2.1: Input the base size and base distribution of the number to be displayed;

[0048] Step 2.2: Determine whether the first intermediate value is greater than 0 or whether the intermediate value transition value is not empty. If not, proceed to step 2.6.

[0049] Step 2.3: Determine whether the second intermediate quantity is greater than or equal to the second threshold parameter. If so, proceed to step 2.10.

[0050] Step 2.4: Determine if the intermediate transition value is not empty. If it is, proceed to step 2.8.

[0051] Step 2.5: Determine whether the conversion device is in the off state and whether the first intermediate quantity is greater than 0. If so, proceed to step 2.9.

[0052] Step 2.6: Determine whether the conversion device is in the off state and whether the second intermediate quantity is greater than 0. If so, proceed to step 2.10.

[0053] Step 2.7: If the pop-up operation fails, proceed to the push-in operation or close the conversion device; the algorithm ends.

[0054] Step 2.8: Increase the value of the second intermediate quantity and decrease the intermediate quantity transition value, then proceed to step 2.2;

[0055] Step 2.9: Divide the current first intermediate quantity by the size of the intermediate quantity base to obtain the first intermediate quantity, and divide the current first intermediate quantity by the size of the intermediate quantity base to obtain the intermediate quantity transition value, then go to step 2.2;

[0056] Step 2.10: The release algorithm is used to calculate the new second intermediate quantity and output symbol. The pop operation is successfully completed, and the algorithm ends.

[0057] According to the present invention, a non-uniform storage medium data encoding and decoding method based on symbol preference is provided, which increases the value of a second intermediate quantity and decreases the intermediate quantity transition value, comprising:

[0058] Step 3.1: Determine if the first intermediate quantity is greater than 0. If not, proceed to step 3.4.

[0059] Step 3.2: If the second intermediate quantity is equal to 0 and the intermediate quantity transition value is equal to 0, then the zero value counter is incremented by 1; otherwise, the second intermediate quantity is multiplied by the size of the intermediate quantity base and the intermediate quantity transition value is added to obtain a new second intermediate quantity.

[0060] Step 3.3: Set the intermediate transition value to an empty state;

[0061] Step 3.4: Multiply the second intermediate value by the size of the intermediate base and add the intermediate transition value to obtain a new second intermediate value;

[0062] Step 3.5: If the zero counter is greater than 0, the zero counter is decremented by 1 and the intermediate transition value is set to 0; otherwise, the intermediate transition value is set to an empty state.

[0063] Step 3.6, operation complete.

[0064] Secondly, the present invention also provides a data encoding and decoding system for non-uniform storage media based on symbol preference, comprising:

[0065] The acquisition module is used to acquire a mixed-base data stream of a determined length to be encoded with sign preference, wherein each position of the mixed-base data stream of a determined length to be encoded includes base size, base distribution and sign size;

[0066] The selection algorithm is used to calculate the set of optional threshold parameters for the conversion device using a threshold selection algorithm, filter the encoding and decoding threshold parameters from the set of optional threshold parameters, determine the intermediate radix size, and initialize the conversion device based on the encoding and decoding threshold parameters and the intermediate radix size;

[0067] The encoding module is used to turn on the conversion device, repeatedly apply the push algorithm and pop algorithm to the mixed base data stream of a certain length to be encoded until the mixed base data stream of a certain length to be encoded is completely pushed in, turn off the conversion device, repeatedly apply the pop algorithm to the mixed base data stream of a certain length to be encoded until the mixed base data stream of a certain length to be encoded is completely popped out, and output the encoded data stream;

[0068] The decoding module is used to turn on the conversion device in the reverse order of encoding, repeatedly apply the push-in algorithm and pop-out algorithm to the encoded data stream until the encoded data stream is completely pushed in, turn off the conversion device, repeatedly apply the pop-out algorithm to the encoded data stream until the encoded data stream is completely popped out, and output the decoded original data.

[0069] The push algorithm includes an absorption algorithm, the pop algorithm includes a release algorithm, and both the absorption algorithm and the release algorithm include a reordering algorithm, which is controlled by a first threshold parameter and a second threshold parameter.

[0070] Thirdly, the present invention also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the symbol preference-based non-uniform storage medium data encoding and decoding method as described above.

[0071] The present invention provides a data encoding and decoding method and system for non-uniform storage media based on symbol preference. Through an efficient streaming data encoding and decoding algorithm, it effectively solves the problem of low efficiency caused by traditional data storage methods on non-uniform storage media, makes full use of the storage space of non-uniform storage media, and achieves more efficient and reliable data storage. Attached Figure Description

[0072] To more clearly illustrate the technical solutions in this invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this invention. For those skilled in the art, other drawings can be obtained from these drawings without creative effort.

[0073] Figure 1 This is a flowchart illustrating the data encoding and decoding method for non-uniform storage media based on symbol preference provided by the present invention.

[0074] Figure 2 This is a schematic diagram of the data conversion process performed by the conversion device provided by the present invention;

[0075] Figure 3 This is a schematic diagram of the conversion device used for the encoding and decoding algorithms provided by this invention;

[0076] Figure 4 This is a schematic diagram of the push-in algorithm provided by the present invention;

[0077] Figure 5 This is a schematic diagram of the pop-up algorithm provided by the present invention;

[0078] Figure 6 This is a schematic diagram of the structure of the non-uniform storage medium data encoding and decoding system based on symbol preference provided by the present invention;

[0079] Figure 7 This is a schematic diagram of the structure of the electronic device provided by the present invention. Detailed Implementation

[0080] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0081] To address the issue of low efficiency in traditional encoding and decoding algorithms, this invention proposes a streaming processing algorithm. By controlling the threshold parameter, the computational load of each step can be kept within a certain range, thereby reducing the computational complexity and improving computational efficiency. Furthermore, it extends existing algorithms to meet the mutual conversion between biased mixed base data, enabling the algorithm to adapt to a wider range of situations and improve encoding / decoding efficiency and storage efficiency in more complex scenarios.

[0082] Figure 1This is a flowchart illustrating the data encoding and decoding method for non-uniform storage media based on symbol preference provided in an embodiment of the present invention, as shown below. Figure 1 As shown, it includes:

[0083] Step 100: Obtain a mixed-base data stream of a determined length to be encoded with sign preference, wherein each position of the mixed-base data stream of a determined length to be encoded includes base size, base distribution and sign size;

[0084] Step 200: Calculate the set of optional threshold parameters for the conversion device using a threshold selection algorithm, filter the encoding / decoding threshold parameters from the set of optional threshold parameters, determine the intermediate radix size, and initialize the conversion device based on the encoding / decoding threshold parameters and the intermediate radix size;

[0085] Step 300: Turn on the conversion device, repeatedly apply the push algorithm and pop algorithm to the mixed base data stream of a certain length to be encoded until the mixed base data stream of a certain length to be encoded is pushed in, turn off the conversion device, repeatedly apply the pop algorithm to the mixed base data stream of a certain length to be encoded until the mixed base data stream of a certain length to be encoded is popped out, and output the encoded data stream;

[0086] Step 400: In the reverse order of encoding, turn on the conversion device, repeatedly apply the push-in algorithm and pop-out algorithm to the encoded data stream until the encoded data stream is completely pushed in, turn off the conversion device, repeatedly apply the pop-out algorithm to the encoded data stream until the encoded data stream is completely popped out, and output the decoded original data;

[0087] The push algorithm includes an absorption algorithm, the pop algorithm includes a release algorithm, and both the absorption algorithm and the release algorithm include a reordering algorithm, which is controlled by a first threshold parameter and a second threshold parameter.

[0088] This invention discloses a non-uniform storage medium data based on symbol preference, with a conversion device as the core device, which completes the conversion between data streams with low computational complexity. Two threshold parameters, namely the first threshold parameter and the second threshold parameter, are obtained through a threshold selection algorithm. The conversion device can be used to derive matching encoding and decoding algorithms to complete the data conversion between any biased mixed bases.

[0089] Specifically, the algorithm performs encoding and decoding operations on any biased mixed-base data. For data that needs to be encoded, the algorithm first determines the base size and base distribution of the data to be encoded, as well as the base size and base distribution of the encoded result sequence. Then, it uses a threshold selection algorithm to calculate the set of legal threshold parameters available to the conversion device. After the user determines the appropriate threshold parameters and intermediate base size, the conversion devices in the encoding and decoding algorithms are initialized using the same set of parameters. The encoding algorithm can encode the data to be encoded to obtain the encoded result data sequence. Then, the user can use the decoding algorithm to decode the result sequence back to the original data to be encoded.

[0090] The specific process of the encoding algorithm includes:

[0091] Suppose the input is a finite-length biased mixed-base data stream, where each position contains three contents: base size, base distribution, and sign size.

[0092] Provide a sufficiently large space for the encoded output stream, where each position contains the base size and base distribution;

[0093] Initialize the conversion device using a set of available parameters and turn it on;

[0094] The device is repeatedly used to perform push-in and pop-out operations, continuously pushing information from the input stream into the device. When pushing fails, the pop-out operation is used to output information until the input stream is exhausted.

[0095] Turn off the device and repeatedly use the pop-up operation until all the information in the device has been completely popped out.

[0096] When the algorithm ends, the actual output content in the output stream space is the encoded data.

[0097] Similarly, the specific process of the decoding algorithm is as follows:

[0098] Suppose the input is an encoded data stream, where each position contains three contents: base size, base distribution, and sign size;

[0099] Provides the same decoding data stream space as before encoding, where each position contains the base size and base distribution;

[0100] Initialize the conversion device using the same set of parameters as during encoding, and then turn on the device;

[0101] In the reverse order of encoding, the device is repeatedly used to perform push and pop operations, continuously pushing information from the input stream into the device. When pushing fails, the pop operation is used to output information until the input stream is exhausted.

[0102] Turn off the device and repeatedly use the pop-up operation until all the information in the device has been completely popped out.

[0103] Once the algorithm ends, the actual output content in the output stream space is the decoded original data.

[0104] It is understood that the encoding and decoding algorithms in the embodiments of the present invention require a conversion device to correctly complete the reversible encoding and decoding operations, that is, a conversion device with the same threshold parameters and intermediate bases; the conversion device is self-contained and, with appropriate initialization parameters, can complete the conversion operation of streaming data, receive input through push operation, output data through pop operation, and can control the opening and closing of the conversion device.

[0105] like Figure 2 As shown, the user can turn the conversion device on and off. The push algorithm can only be used when the device is on, and the pop algorithm can only be used to completely output the internal information when the device is off. The conversion device can use the push algorithm to input information once. The information includes the base size, base distribution, and sign size. After the push algorithm is executed, it will prompt the user whether the push was successful. The conversion device can also use the pop algorithm to output information once. The input of the pop algorithm is the base size and base distribution of the information, and the output is the sign size. After the pop algorithm is executed, it will return the sign size or prompt the user that the pop failed. The conversion device contains an absorption algorithm and a release algorithm. The absorption algorithm directly controls the size of the first intermediate quantity n1 and the intermediate quantity transition value s, and the release algorithm directly controls the size of the intermediate quantity transition value s and the second intermediate quantity n2.

[0106] The conversion device also includes a first threshold parameter and a second threshold parameter. The push-in algorithm and the pop-out algorithm can adjust the size of the three intermediate quantities through the absorption algorithm and the release algorithm under the restriction of the threshold parameter. When the push-in algorithm is executed, the pushed-in information will flow through the intermediate quantities n1, s, and n2 in sequence until the three intermediate quantities cannot add more information under the control of the threshold parameter, at which point the push-in algorithm fails. When the pop-out algorithm is executed, the popped information will flow out from the intermediate quantities n1, s, and n2 in sequence until the three intermediate quantities cannot decrease under the control of the threshold parameter, at which point the pop-out algorithm fails. When the device is in the off state, the push-in algorithm cannot be used. At this time, the pop-out algorithm can output all the information without being restricted by the threshold parameter.

[0107] Therefore, the information flow path of the entire conversion device is: push in, absorb, intermediate quantity n1, intermediate quantity s, intermediate quantity n2, release, and pop out. The magnitude of the three intermediate quantities is controlled by two threshold parameters, so the conversion device can complete the information conversion with low computational complexity. In addition, the conversion device also includes a zero-value counter, which is used to record the number of leading zeros generated during the conversion process. After the device is turned on, the counter can be probabilistically increased using the push in algorithm, and the counter can be decreased using the pop out algorithm when the device is turned off.

[0108] For example Figure 3 As shown, during the encoding operation, the conversion device pushes each piece of information in the input data stream in a given order and pops it out in the same order. The user needs to repeatedly check the success of the push and pop operations and alternately perform the push and pop operations to continuously encode the input information stream.

[0109] A conversion device is also required when performing decoding operations using a decoding algorithm. The user provides the output stream encoded by the encoding device, containing information including the radix, radix distribution, and corresponding sign of each bit of data. During decoding, the conversion device decodes the data stream in the reverse order of encoding, such as... Figure 3 As shown, if the original information stream is encoded from left to right to obtain the encoded output stream sequence, then the decoder needs to perform a decoding operation from right to left on the encoded output stream sequence. The conversion device sequentially traverses the base size, base distribution, and sign of each bit of the input information and performs calculations and conversions.

[0110] Based on this, the encoding and decoding algorithms are executed sequentially using the conversion device, and the encoding and decoding operations of the sequence information are completed by repeatedly and alternately using the push and pop algorithms. Before executing the encoding and decoding algorithms, the conversion device needs to be set to the on state. When the encoding and decoding algorithms stop inputting information, the conversion device needs to be set to the off state so that the pop algorithm can be used to output the complete remaining information in the conversion device.

[0111] This invention effectively solves the problem of low efficiency caused by traditional data storage methods on non-uniform storage media by using a high-efficiency streaming data encoding and decoding algorithm, making full use of the storage space of non-uniform storage media to achieve more efficient and reliable data storage.

[0112] Based on the above embodiments, since both the absorption algorithm and the release algorithm in the embodiments of the present invention adopt a reordering algorithm, the specific process includes:

[0113] Given the number base size and the distribution of integers in the number base to be calculated;

[0114] Iterate through the sign values ​​of the base from smallest to largest, and for each sign value, iterate through the integer distribution values ​​of the sign value from 0 to the distribution value minus 1. Use the sign value as the horizontal axis and 0 to the distribution value minus 1 as the vertical axis to obtain a set of points under the sign value. Finally, obtain the set of all points for all sign values.

[0115] Sort these points in ascending order using the ordinate as the primary key and the x-axis as the secondary key.

[0116] Returns the sorted sequence of points.

[0117] Specifically, an example of the reordering algorithm is as follows:

[0118] Assume the base size is 6, and the base distribution is [1, 2, 6, 2, 3, 2].

[0119] Generate point set: (0,0), (1,0), (1,1), (2,0), (2,1), (2,2), (2,3),

[0120] (2,4), (2,5), (3,0), (3,1), (4,0), (4,1), (4,2), (5,0), (5,1);

[0121] Sort the point set to get: (0,0), (1,0), (2,0), (3,0), (4,0), (5,0), (1,1).

[0122] (2,1), (3,1), (4,1), (5,1), (2,2), (4,2), (2,3), (2,4), (2,5);

[0123] Returns the sorted new set of points.

[0124] Based on the above embodiments, the conversion device requires two threshold parameters, and the specific process of the threshold selection algorithm is as follows:

[0125] Input a series of integer values ​​in different bases;

[0126] Calculate the sum of the distribution values ​​of each signed integer in each number base;

[0127] For this set of number systems, the available threshold is the common multiple of all sums.

[0128] The two corresponding threshold parameters are calculated as follows:

[0129] For the first threshold parameter, the threshold selection algorithm is used to calculate the possible parameter set of the first threshold parameter by taking all possible bases and their distribution in the input stream as parameters.

[0130] For the second threshold parameter, the threshold selection algorithm is used to calculate the possible parameter set of the second threshold parameter by taking all possible bases and their distribution in the output stream as parameters.

[0131] Based on the above embodiments, the absorption algorithm in the embodiments of the present invention includes:

[0132] Input intermediate values, number base, number base distribution, and sign value;

[0133] The reordering algorithm is used to calculate the input base size and base distribution to obtain a point set sequence;

[0134] Calculate the sum of the integer distributions in this base, which means summing all the input distributed numbers.

[0135] Calculate the quotient and remainder when the intermediate quantity is divided by the integer value of the distribution corresponding to the sign size;

[0136] Use the sign value as the x-axis and the remainder as the y-axis to query the position in the point set sequence;

[0137] The new intermediate quantity is calculated by multiplying the quotient by the sum of the distributions and then adding the position in the sequence.

[0138] Return the new intermediate value.

[0139] Based on the above embodiments, the release algorithm in the embodiments of the present invention includes:

[0140] Input intermediate values, number base size, and number base distribution;

[0141] The reordering algorithm is used to calculate the input base size and base distribution to obtain a point set sequence;

[0142] Calculate the sum of the integer distributions in this base, which means summing all the input distributed numbers.

[0143] Calculate the quotient and remainder when the intermediate quantity is divided by the sum of the distributions;

[0144] Use the remainder to find the x and y coordinates of the corresponding point in the point set sequence;

[0145] The new intermediate quantity is calculated by multiplying the quotient by the integer value of the distribution corresponding to the horizontal axis and adding the vertical axis;

[0146] Returns the new intermediate value, along with the x-coordinate as the sign value.

[0147] Based on the above embodiments, such as Figure 4As shown, the push-in algorithm in this embodiment of the invention needs to repeatedly check the state of the three intermediate quantities in the device. The goal of the push-in algorithm is to absorb the input information into the intermediate quantity n1 through the absorption algorithm. However, under the control of two threshold parameters and the intermediate quantity base, the size of the three intermediate quantities is limited. It is necessary to repeatedly try to adjust the size between the intermediate quantities to pass the information backward until the input information can be absorbed by the absorption algorithm. Otherwise, the push-in algorithm fails and the pop-out algorithm needs to be executed first. The specific implementation process includes:

[0148] Step 1.1: Input the symbol size, number base, and number base distribution to be pushed;

[0149] Step 1.2: Using the intermediate quantity n1, the base size, the base distribution, and the sign size as parameters, the absorption algorithm is used to calculate the expected new value of n1.

[0150] Step 1.3: Is the expected new n1 value less than the intermediate base multiplied by the threshold parameter 1? If so, proceed to step 1.7.

[0151] Step 1.4: Is the intermediate quantity s empty? If so, proceed to step 1.8.

[0152] Step 1.5: Is the intermediate quantity n2 less than the threshold parameter 2? If so, proceed to step 1.9.

[0153] Step 1.6: The push operation failed, and an eject operation needs to be performed first. The algorithm ends here.

[0154] Step 1.7: The push operation is successfully performed by replacing the current n1 with the expected n1, and the algorithm ends;

[0155] Step 1.8: Calculate n1 by dividing the current n1 by the intermediate base, calculate s by modulo the current n1 by the intermediate base, and go to step 1.2.

[0156] Step 1.9: Increase the value of n2 and decrease the value of s, then proceed to step 1.2.

[0157] Based on the above embodiments, such as Figure 5 As shown, the pop-out algorithm needs to repeatedly check the state of three intermediate quantities within the device. The goal of the pop-out algorithm is to output information from the intermediate quantity n2 through the release algorithm. However, under the control of two threshold parameters and the intermediate quantity base, the size of the three intermediate quantities is limited. It is necessary to repeatedly try to adjust the size between the intermediate quantities to pass the information backward until the release algorithm can be used to output information. Otherwise, the pop-out algorithm will fail and the push algorithm needs to be executed first. The specific implementation process includes:

[0158] Step 2.1: Input the base size and base distribution of the data to be popped up;

[0159] Step 2.2: Determine if n1 is greater than 0 or s is not empty. If not, proceed to step 2.6.

[0160] Step 2.3: Determine if n2 is greater than or equal to the threshold parameter 2. If so, proceed to step 2.10.

[0161] Step 2.4: Determine if s is not empty. If it is, proceed to step 2.8.

[0162] Step 2.5: Determine if the conversion device is off and n1 is greater than 0. If so, proceed to step 2.9.

[0163] Step 2.6: Determine whether the conversion device is in the off state and whether the second intermediate quantity is greater than 0. If so, proceed to step 2.10.

[0164] Step 2.7: If the pop-up operation fails, you need to perform a push operation or close the conversion device first, and then the algorithm ends.

[0165] Step 2.8: Increase the value of n2 and decrease the value of s, then proceed to step 2.2;

[0166] Step 2.9: Calculate n1 by dividing the current n1 by the intermediate base, calculate s by modulo the current n1 by the intermediate base, and go to step 2.2.

[0167] Step 2.10: Use the release algorithm to calculate the new n2 and output the symbol. Successfully complete the pop operation and the algorithm ends.

[0168] Based on this, the push and pop algorithms utilize the step of increasing the value of n2 and decreasing the value of s. The specific process is as follows:

[0169] Step 3.1: Determine if n1 is greater than 0. If not, proceed to step 3.4.

[0170] Step 3.2: If n2 equals 0 and s equals 0, then increment the zero counter by one; otherwise, calculate n2 as n2 multiplied by the intermediate base plus s.

[0171] Step 3.3: Set the intermediate quantity s to an empty state;

[0172] Step 3.4, calculate n2 as n2 multiplied by the intermediate base plus s;

[0173] Step 3.5: If the zero counter is greater than 0, the counter is decremented by one and s is set to 0; otherwise, s is set to an empty state.

[0174] Step 3.6, operation complete.

[0175] In the push and pop algorithms, the push algorithm must return a push failure directly when the device is closed, and the device needs to be turned on; while when the input stream ends, if you want to use the pop algorithm to output all information, you need to close the device until the pop algorithm returns a pop failure.

[0176] Therefore, the conversion device needs to have the following process:

[0177] The input parameters for the conversion device are: first threshold parameter 1, second threshold parameter, and intermediate quantity base;

[0178] The converter is initialized: n1 and n2 are set to 0, s is set to empty, the zero-value counter is set to 0, and the device is initially in the off state.

[0179] The device can be opened, closed, pushed in, and ejected.

[0180] In summary, this invention has the following advantages and innovations compared to traditional encoding and decoding methods:

[0181] (1) In terms of data storage, it can be used for data storage of non-uniform storage media such as DNA sequences, and has a high data storage density, saves storage media, makes full use of the storage space of storage media, and improves storage efficiency by increasing information entropy;

[0182] (2) The algorithm of the present invention can realize the conversion of biased mixed base data to biased mixed base data, and realizes the data conversion form of both input and output data being biased mixed base data. It is a major innovation in the entropy algorithm class of algorithms.

[0183] (3) In terms of computational performance, the conversion algorithm performs streaming computation, eliminating the need to process all input and output content at once, thus reducing the time complexity of traditional algorithms from O(n^2) to O(n^2). 2 The computational efficiency is reduced to O(n). This greatly improves the computational efficiency of data encoding and decoding, saves computation time, and meets real-time requirements, enabling instant computation.

[0184] (4) In terms of engineering implementation, the core content conversion device of the present invention can be implemented using any programming language, has good encapsulation, and can be deployed to different platforms for operation, which reduces the development difficulty and makes it easy to implement and use.

[0185] The following describes the symbol preference-based non-uniform storage medium data encoding and decoding system provided by the present invention. The symbol preference-based non-uniform storage medium data encoding and decoding system described below can be referred to in correspondence with the symbol preference-based non-uniform storage medium data encoding and decoding method described above.

[0186] Figure 6This is a schematic diagram of the structure of a non-uniform storage medium data encoding and decoding system based on symbol preference provided in an embodiment of the present invention, as shown below. Figure 6 As shown, it includes: an acquisition module 61, a selection algorithm 62, an encoding module 63, and a decoding module 64, wherein:

[0187] The acquisition module 61 is used to acquire a mixed-base data stream of a determined length to be encoded with sign preference, wherein each position of the mixed-base data stream includes base size, base distribution, and sign size; the selection algorithm 62 is used to calculate the set of optional threshold parameters for the conversion device using a threshold selection algorithm, filter encoding and decoding threshold parameters from the set of optional threshold parameters, determine the intermediate base size, and initialize the conversion device based on the encoding and decoding threshold parameters and the intermediate base size; the encoding module 63 is used to turn on the conversion device, repeatedly apply the push algorithm and pop algorithm to the mixed-base data stream of a determined length to be encoded until the mixed-base data stream of a determined length to be encoded is pushed in, and then turn off the conversion device. The conversion device repeatedly applies a pop-up algorithm to the mixed-base data stream of a determined length to be encoded until the mixed-base data stream of a determined length to be encoded is completely popped, and outputs the encoded data stream; the decoding module 64 is used to turn on the conversion device in the reverse order of encoding, repeatedly apply a push-in algorithm and a pop-up algorithm to the encoded data stream until the encoded data stream is completely pushed in, turn off the conversion device, repeatedly apply the pop-up algorithm to the encoded data stream until the encoded data stream is completely popped, and output the decoded original data; wherein, the push-in algorithm includes an absorption algorithm, the pop-up algorithm includes a release algorithm, the absorption algorithm and the release algorithm both include a reordering algorithm, and are controlled by a first threshold parameter and a second threshold parameter.

[0188] Figure 7 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 7As shown, the electronic device may include: a processor 710, a communication interface 720, a memory 730, and a communication bus 740, wherein the processor 710, the communication interface 720, and the memory 730 communicate with each other through the communication bus 740. The processor 710 can call logical instructions in the memory 730 to execute a data encoding / decoding method based on symbol preference for a non-uniform storage medium. This method includes: acquiring a mixed-base data stream of a determined length to be encoded with symbol preference, wherein each position of the mixed-base data stream includes base size, base distribution, and symbol size; calculating a set of optional threshold parameters for the conversion device using a threshold selection algorithm; filtering encoding / decoding threshold parameters from the set of optional threshold parameters and determining an intermediate base size; initializing the conversion device based on the encoding / decoding threshold parameters and the intermediate base size; activating the conversion device; and repeatedly applying a push algorithm and a pop algorithm to the mixed-base data stream of the determined length to be encoded until the data is fully encoded. Once the mixed-base data stream of a certain length is fully pushed in, the conversion device is turned off. The pop-out algorithm is repeatedly applied to the mixed-base data stream of a certain length to be encoded until it is fully popped out, and the encoded data stream is output. Then, in the reverse order of encoding, the conversion device is turned on, and the pushing and pop-out algorithms are repeatedly applied to the encoded data stream until it is fully pushed in. The conversion device is turned off, and the pop-out algorithm is repeatedly applied to the encoded data stream until it is fully popped out, and the decoded original data is output. The pushing algorithm includes an absorption algorithm, the pop-out algorithm includes a release algorithm, and both the absorption algorithm and the release algorithm include a reordering algorithm, which is controlled by a first threshold parameter and a second threshold parameter.

[0189] Furthermore, the logical instructions in the aforementioned memory 730 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, essentially, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0190] On the other hand, the present invention also provides a non-transitory computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements a data encoding and decoding method for a non-uniform storage medium based on symbol preference provided by the methods described above. The method includes: acquiring a mixed-base data stream of a determined length to be encoded with symbol preference, wherein each position of the mixed-base data stream includes a base size, a base distribution, and a symbol size; calculating a set of optional threshold parameters for a conversion device using a threshold selection algorithm; filtering encoding and decoding threshold parameters from the set of optional threshold parameters and determining an intermediate base size; initializing the conversion device based on the encoding and decoding threshold parameters and the intermediate base size; and activating the conversion device to repeatedly acquire data from the mixed-base data stream of the determined length to be encoded. The conversion device is then closed, and the pop-out algorithm is repeatedly applied to the mixed-base data stream of a determined length to be encoded until it is completely popped. The encoded data stream is then output. Following the reverse order of encoding, the conversion device is then turned on, and the pop-out algorithm is repeatedly applied to the encoded data stream until it is completely popped. The conversion device is then closed, and the pop-out algorithm is repeatedly applied to the encoded data stream until it is completely popped. The decoded original data is then output. The pop-out algorithm includes an absorption algorithm, and the pop-out algorithm includes a release algorithm. Both the absorption and release algorithms include a reordering algorithm, which is controlled by a first threshold parameter and a second threshold parameter.

[0191] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.

[0192] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.

[0193] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A data encoding and decoding method for non-uniform storage media based on symbol preference, characterized in that, include: Obtain a mixed-base data stream of a determined length to be encoded with sign preference, wherein each position of the mixed-base data stream of a determined length to be encoded includes base size, base distribution, and sign size; A threshold selection algorithm is used to calculate the set of optional threshold parameters for the conversion device. Encoding and decoding threshold parameters are selected from the set of optional threshold parameters, and the intermediate radix size is determined. The conversion device is initialized based on the encoding and decoding threshold parameters and the intermediate radix size. The conversion device is turned on, and the push algorithm and pop algorithm are repeatedly applied to the mixed base data stream of a certain length to be encoded until the mixed base data stream of a certain length to be encoded is completely pushed on. The conversion device is turned off, and the pop algorithm is repeatedly applied to the mixed base data stream of a certain length to be encoded until the mixed base data stream of a certain length to be encoded is completely popped, and the encoded data stream is output. Following the reverse order of encoding, the conversion device is turned on, and the push-in algorithm and pop-out algorithm are repeatedly applied to the encoded data stream until the encoded data stream is completely pushed in. Then, the conversion device is turned off, and the pop-out algorithm is repeatedly applied to the encoded data stream until the encoded data stream is completely popped out. Finally, the decoded original data is output. The push algorithm includes an absorption algorithm, the pop algorithm includes a release algorithm, and both the absorption algorithm and the release algorithm include a reordering algorithm, which is controlled by a first threshold parameter and a second threshold parameter.

2. The data encoding and decoding method for non-uniform storage media based on symbol preference according to claim 1, characterized in that, The reordering algorithm includes: Determine the number system size and integer distribution of the data stream; Traverse the symbol values ​​of all bases in ascending order. Based on the distribution value of each symbol integer, traverse each symbol value from 0 to the distribution value of each symbol integer minus 1. Use the distribution value of each symbol integer as the x-axis and 0 to the distribution value of each symbol integer minus 1 as the y-axis to obtain the set of all points of all symbol values. Sort all points with all symbol values ​​in ascending order using the ordinate as the first key and the abscissa as the second key, to obtain a sorted sequence of point sets.

3. The data encoding and decoding method for non-uniform storage media based on symbol preference according to claim 1, characterized in that, The threshold selection algorithm includes: Input integers from multiple bases, distributed across different values; Calculate the sum of the distribution values ​​of each signed integer in each number base; The available threshold for determining any set of number base distributions is the common multiple of all sums; Correspondingly, the threshold selection algorithm is used to calculate all bases and their distributions in the input stream to obtain a set of optional parameters for the first threshold parameter; The threshold selection algorithm is used to calculate all bases and their distributions in the output stream to obtain the set of optional parameters for the second threshold parameter.

4. The data encoding and decoding method for non-uniform storage media based on symbol preference according to claim 1, characterized in that, The absorption algorithm includes: Input intermediate values, number base, number base distribution, and sign value; The reordering algorithm is used to calculate the base size and the base distribution to obtain a point set sequence; Sum all the distributed digits in the current base to obtain the sum of the integer distribution values ​​in the current base; Calculate the quotient and remainder when the intermediate quantity is divided by the integer values ​​of the distribution corresponding to the sign size; The distribution position of the point set sequence is obtained by using the sign size as the x-axis and the remainder as the y-axis; Multiply the quotient by the sum of the integer distributions, and add the distribution position of the point set sequence to obtain a new intermediate quantity.

5. The data encoding and decoding method for non-uniform storage media based on symbol preference according to claim 1, characterized in that, The release algorithm includes: Input intermediate values, number base, number base distribution, and sign value; The reordering algorithm is used to calculate the base size and the base distribution to obtain a point set sequence; Sum all the distributed digits in the current base to obtain the sum of the integer distribution values ​​in the current base; Calculate the quotient and remainder when the intermediate quantity is divided by the sum of the integer distributions; Find the corresponding position point and its x and y coordinates in the point set sequence based on the remainder; Multiply the quotient by the integer value of the distribution corresponding to the horizontal axis, and add it to the vertical axis to obtain a new intermediate quantity, and use the horizontal axis as the sign value.

6. The data encoding and decoding method for non-uniform storage media based on symbol preference according to claim 1, characterized in that, The push-in algorithm includes: Step 1.1: Input the symbol size, number base, and number base distribution to be pushed; Step 1.2: Use the absorption algorithm to calculate the first intermediate quantity, sign size, base size, and base distribution to obtain a new first intermediate quantity; Step 1.3: Determine whether the new first intermediate quantity is less than the intermediate quantity base size multiplied by the first threshold parameter. If so, proceed to step 1.

7. Step 1.4: Determine if the intermediate transition value is empty. If so, proceed to step 1.

8. Step 1.5: Determine whether the second intermediate quantity is less than the second threshold parameter. If so, proceed to step 1.

9. Step 1.6: If the push operation fails, proceed to the pop operation, and the algorithm ends. Step 1.7: The push operation is successfully performed by replacing the current first intermediate value with the new first intermediate value, and the algorithm ends. Step 1.8: Divide the current first intermediate quantity by the size of the intermediate quantity base to obtain the first intermediate quantity, and divide the current first intermediate quantity by the size of the intermediate quantity base to obtain the intermediate quantity transition value, then proceed to step 1.2; Step 1.9: Increase the value of the second intermediate quantity and decrease the intermediate quantity transition value, then proceed to step 1.

2.

7. The data encoding and decoding method for non-uniform storage media based on symbol preference according to claim 1, characterized in that, The pop-up algorithm includes: Step 2.1: Input the base size and base distribution of the number to be displayed; Step 2.2: Determine whether the first intermediate value is greater than 0 or whether the intermediate value transition value is not empty. If not, proceed to step 2.

6. Step 2.3: Determine whether the second intermediate quantity is greater than or equal to the second threshold parameter. If so, proceed to step 2.

10. Step 2.4: Determine if the intermediate transition value is not empty. If it is, proceed to step 2.

8. Step 2.5: Determine whether the conversion device is in the off state and whether the first intermediate quantity is greater than 0. If so, proceed to step 2.

9. Step 2.6: Determine whether the conversion device is in the off state and whether the second intermediate quantity is greater than 0. If so, proceed to step 2.

10. Step 2.7: If the pop-up operation fails, proceed to the push-in operation or close the conversion device; the algorithm ends. Step 2.8: Increase the value of the second intermediate quantity and decrease the intermediate quantity transition value, then proceed to step 2.2; Step 2.9: Divide the current first intermediate quantity by the size of the intermediate quantity base to obtain the first intermediate quantity, and divide the current first intermediate quantity by the size of the intermediate quantity base to obtain the intermediate quantity transition value, then go to step 2.2; Step 2.10: The release algorithm is used to calculate the new second intermediate quantity and output symbol. The pop operation is successfully completed, and the algorithm ends.

8. The data encoding and decoding method for non-uniform storage media based on symbol preference according to claim 6 or 7, characterized in that, Increase the value of the second intermediate value and decrease the intermediate value transition value, including: Step 3.1: Determine if the first intermediate quantity is greater than 0. If not, proceed to step 3.

4. Step 3.2: If the second intermediate quantity is equal to 0 and the intermediate quantity transition value is equal to 0, then the zero value counter is incremented by 1; otherwise, the second intermediate quantity is multiplied by the size of the intermediate quantity base and the intermediate quantity transition value is added to obtain a new second intermediate quantity. Step 3.3: Set the intermediate transition value to an empty state; Step 3.4: Multiply the second intermediate value by the size of the intermediate base and add the intermediate transition value to obtain a new second intermediate value; Step 3.5: If the zero value counter is greater than 0, the zero value counter is decremented by 1, and the intermediate value is set to 0; otherwise, the intermediate value is set to an empty state. Step 3.6, operation complete.

9. A data encoding and decoding system for non-uniform storage media based on symbol preference, characterized in that, include: The acquisition module is used to acquire a mixed-base data stream of a determined length to be encoded with sign preference, wherein each position of the mixed-base data stream of a determined length to be encoded includes base size, base distribution and sign size; The selection algorithm is used to calculate the set of optional threshold parameters for the conversion device using a threshold selection algorithm, filter the encoding and decoding threshold parameters from the set of optional threshold parameters, determine the intermediate radix size, and initialize the conversion device based on the encoding and decoding threshold parameters and the intermediate radix size; The encoding module is used to turn on the conversion device, repeatedly apply the push algorithm and pop algorithm to the mixed base data stream of a certain length to be encoded until the mixed base data stream of a certain length to be encoded is completely pushed in, turn off the conversion device, repeatedly apply the pop algorithm to the mixed base data stream of a certain length to be encoded until the mixed base data stream of a certain length to be encoded is completely popped out, and output the encoded data stream; The decoding module is used to turn on the conversion device in the reverse order of encoding, repeatedly apply the push-in algorithm and pop-out algorithm to the encoded data stream until the encoded data stream is completely pushed in, turn off the conversion device, repeatedly apply the pop-out algorithm to the encoded data stream until the encoded data stream is completely popped out, and output the decoded original data. The push algorithm includes an absorption algorithm, the pop algorithm includes a release algorithm, and both the absorption algorithm and the release algorithm include a reordering algorithm, which is controlled by a first threshold parameter and a second threshold parameter.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the non-uniform storage medium data encoding and decoding method based on symbol preference as described in any one of claims 1 to 8.

Images