10 results about "Fixed length" patented technology

The invention relates to the technical field of data storage, and discloses a numerical data variable-length coding storage method, device, equipment and medium, which comprises the following steps: converting target numerical data into fixed-length binary representation according to definition precision, executing filling removal interception processing on an integer part, executing digital-level packet compression coding on a decimal part, and performing variable-length coding on the target numerical data; and generating a variable-length binary sequence containing length information and symbol information, and writing the sequence into a storage medium to realize compact storage of numerical data. According to the method, redundant filling bytes are eliminated from an integer part, compressed encoding is performed on a decimal part according to effective digits, and unified processing of sign bits is combined, so that a storage space dynamically changes along with actual numerical digits on the premise of keeping numerical precision and analyzability, space waste of fixed-length numerical types is reduced, and the method is suitable for large-scale popularization and application. Meanwhile, the precision error of the floating-point number is avoided, and the storage efficiency and the data reliability are improved.

The invention provides a multi-version management method for database fixed-length fields, a medium and a product. The multi-version management method for the database fixed-length fields comprises the steps of configuring a preset shadow version number for target fixed-length fields or target fixed-length field groups in a database table; constructing a shadow column set for the target fixed-length field or the target fixed-length field group in the row of the database table; constructing a plurality of shadow versions in the shadow column set into an end-to-end circular queue, and setting an identifier to record a serial number of a current writable version in the circular queue; and in response to a data read-write request, performing read-write operation on the shadow version in the circular queue based on the visibility auxiliary information corresponding to the shadow version, the serial number of the writable version and a preset visibility judgment rule, thereby realizing multi-version management of the target fixed-length field or the target fixed-length field group. According to the scheme, the method is adaptive to a specific scene in which the fixed-length fields are frequently updated and only a limited historical version is needed; and constant storage occupation and stable read-write performance are ensured.

The application provides a high-efficiency KV encoding storage method based on a Redis protocol, and has the characteristics that all Key meta information of a data object is stored in an object key; and descriptive information of the data object, keys of each field in the data object, and values of each field in the data object are all stored in an object value. Preferably, in the high-efficiency KV encoding storage method based on the Redis protocol, the object value is encoded in blocks in a fixed length, a block header of each block stores descriptive information of the data object value, and the rest of each block stores the keys and values of the fields. Preferably, in the high-efficiency KV encoding storage method based on the Redis protocol, the fixed length of the block is an integer multiple of an operating system block. The encoding and storage method of the application reduces the number of I / Os, the number of Key encodings, saves computing resources, and improves the read-write efficiency.

Disclosed in the present invention is a real-time recursive CRC method. The method comprises: sequentially extracting from a real-time bit stream a1a2a3… binary sequences S1S2…Si… at non-fixed lengths; bisecting into left and right parts each binary sequence segment Si, so as to obtain sub-sequences, and repeatedly bisecting into left and right parts the sub-sequences until the lengths of finally obtained sub-sequences are less than a preset value; and calculating a CRC check value and check matrix of each final sub-sequence, and performing level-by-level upward merging calculation on left and right sub-sequences, so as to obtain a final check value of the entire real-time bit stream. Further disclosed in the present invention are a corresponding CRC apparatus and a computer storage medium and a program for implementing the CRC method. In the present invention, a method combining iteration with recursion is used to calculate, in real time, a check value of a variable-length binary sequence stream, thereby achieving logarithmic calculation time complexity and meeting CRC operation requirements of a real-time ultra-high-speed data stream.

There are provided systems and methods for reducing quantization errors, including method of optimizing a routine for a hardware-based processing system having a fixed length two's complement binary representation, the method comprising: receiving an instruction sequence arranged to perform the routine, wherein the instruction sequence comprises a set of arithmetic operations, wherein the outputs of the arithmetic operations exceed a precision of the hardware-based processing system; identifying one or more pairs of sub-sets of instructions in the sequence of instructions, the sub-sets of each pair having a respective comparable truncation error; and generating an optimized routine by modifying one of the sub-sets of each pair to invert the sign of one or more inputs to said sub-sets and modifying the instruction sequence to compensate for the said inversion.

The invention discloses a short character string monotonic order-preserving materialized compression coding method, which comprises the following steps of: performing a series of bit operations such as byte inversion, length information embedding, logic right shift and high-order mask shielding on an original variable-length character string with a limited length, and losslessly mapping the original variable-length character string into a fixed-length integer value; the lexicographical order of the character string before and after mapping is completely consistent with the numerical order of the integer; according to the method, the fixed-length integer code is used for directly replacing an original character string to participate in sequencing, aggregation and comparison operation of the database, so that the problems of branch prediction failure, discontinuous memory access, vectorization difficulty and the like caused by processing variable-length data in a traditional scheme are greatly avoided, the memory occupancy is greatly reduced, and meanwhile, the vectorization efficiency is improved. And the CPU execution efficiency and the cache utilization rate are greatly improved.

The invention relates to the technical field of graph data processing, and provides a graph data processing method based on cache optimization, which comprises the following steps: constructing a cache optimization representation of graph data, and distributing a bit vector GT-vector with a fixed length of k for each vertex in a graph, each bit representing whether the vertex belongs to a pre-calculated maximum independent set; reserving adjacency list representation of the graph data, and storing the adjacency list representation as reference data in a memory; for an edge query request, reading GT-vectors of two vertexes from a CPU cache, and executing bit and operation; if the bit and the result are non-zero, judging that the edge is non-edge and immediately returning a first Boolean result indicating that the edge does not exist; and if the bit and result is zero, querying the adjacency list in the memory for verification, and returning a second Boolean result indicating that the edge exists or does not exist. According to the method and the device, the hybrid architecture combining the bit vector representation of cache optimization and the adjacency list is constructed, so that the magnitude order improvement of the graph data processing performance is realized on the premise of ensuring that the query result is completely accurate.

The embodiment of the invention provides a method, a device, equipment and a medium for judging the packet receiving length in a control packet receiving process, and the method comprises the steps: obtaining an operation code of a control packet when the control packet is received; obtaining a first subsequent data length contained in a packet header in the control packet according to a length field of the control packet; determining the packet receiving length of the control packet according to the operation code and the first subsequent data length; wherein the packet receiving length of the control packet is the data length after the length field. The length field of the packet header is verified through the operation code of the control packet, inconsistency of the length field of the packet header and the fixed length corresponding to the operation code can be found in the packet receiving process, errors can be found in real time, and time delay of a sending mode is avoided. By determining the real packet receiving length, it is ensured that the receiving mode and the sending mode of the current connection interval are switched at the correct time point, and the time sequence is correct. Especially in a high throughput rate scene, invalid transmission in the interval is reduced, the overall speed is improved, and the throughput rate is improved.

This invention discloses a method, system, device, storage medium, and program product for expanding the capacity of a fixed-length counting array based on address translation to prevent overflow. The method includes the following steps: Step 1: Determine the data type and length of the array counting, and allocate contiguous memory; Step 2: Check if the highest column of the array counting has overflowed. If not, increment the count; if overflowed, jump to Step 3; Step 3: Check the non-highest bit. If the lower 15 bits of the address are not all zeros, jump to Step 4; if they are all zeros, jump to Step 5; Step 4: Calculate the new address position based on the offset of the lower 15 bits, and jump to Step 6; Step 5: Allocate a new memory block, record the offset between the new and old addresses in the lower 15 bits of the original address, and jump to Step 6; Step 6: Increment the uint32 type count of the new address by 1, check if the highest bit is 1. If the highest bit is 1, overflow occurs again, and steps 5 to 6 are repeated. This invention provides an address translation-based scheme that can continue to collect counts and avoid copying existing memory, thus avoiding memory waste, and providing efficient statistical and query performance.

The application discloses a method for determining operation instructions in a frame synchronization process, which is applied to the technical field of frame synchronization and is executed by a server. The server is connected with at least two clients. The method comprises the following steps: receiving operation instructions sent by at least one client in the at least two clients; determining a first length of a current frame based on a fixed number of operation instructions carried by a single frame; determining a second length of a redundant frame based on network parameters between the server and the at least two clients; obtaining a residual length of at least one data packet according to a fixed length of a single data packet, the first length and the second length; and determining an extended number of instructions of the current frame according to the residual length of the at least one data packet. Under the premise of meeting the required number of redundant frames, the current frame is dynamically extended to carry more operation instructions, more operation instructions can be sent from the server to the clients, and the game experience of players can be improved.