Data processing method and device for high-frequency read-write

Abstract

The invention discloses a data processing method and device for high-frequency read-write. The method comprises the following steps: acquiring read information to be processed; the to-be-processed read information comprises M pieces of to-be-processed read data information; the to-be-processed read data information comprises a data priority, read identification information and read resource consumption information; classifying the to-be-processed read information to obtain first read information; the first read information comprises N pieces of first read data information; each piece of first read data information comprises at least one piece of first to-be-processed data information; each piece of first to-be-processed data information is in one-to-one correspondence with one piece of to-be-processed read data information; performing data loading processing on the first read information to obtain target read information; the target reading information comprises N pieces of target reading data information; each piece of target read data information comprises at least one piece of target loaded data information.

Description

Technical Field

[0001] The present invention relates to the technical field of data storage and processing, and particularly to a data processing method and device for high-frequency reading and writing. Background Art

[0002] In the big data era, the high-frequency reading and writing operations of massive data pose extremely high requirements on the performance of the storage system. When facing high-frequency reading and writing, traditional storage systems often encounter bottlenecks, resulting in a decrease in the system response speed and even data loss or damage. Especially in scenarios such as financial trading systems, real-time data analysis, and Internet of Things device management, the demand for high-frequency reading and writing is very urgent. Therefore, a data processing method and device for high-frequency reading and writing are provided to improve the high-frequency data reading and writing speed and reliability, and thus effectively meet the high-frequency data reading and writing requirements. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a data processing method and device for high-frequency reading and writing, which are beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meet the high-frequency data reading and writing requirements.

[0004] To solve the above technical problem, in the first aspect, an embodiment of the present invention discloses a data processing method for high-frequency reading and writing, the method comprising:

[0005] Obtaining to-be-processed read information; the to-be-processed read information includes M to-be-processed read data information; the to-be-processed read data information includes data priority, read identification information, and read resource consumption information;

[0006] Classifying and processing the to-be-processed read information to obtain first read information; the first read information includes N first read data information; each of the first read data information includes at least one first to-be-processed data information; each of the first to-be-processed data information corresponds to one of the to-be-processed read data information;

[0007] Performing data loading processing on the first read information to obtain target read information; the target read information includes the N target read data information; each of the target read data information includes at least one target loaded data information.

[0008] In the second aspect, an embodiment of the present invention discloses a data processing device for high-frequency reading and writing, the device comprising:

[0009] An obtaining module, configured to obtain to-be-processed read information; the to-be-processed read information includes M to-be-processed read data information; the to-be-processed read data information includes data priority, read identification information, and read resource consumption information;

[0010] The first processing module is configured to classify the to-be-processed read information to obtain first read information; the first read information includes N pieces of first read data information; each piece of the first read data information includes at least one piece of first to-be-processed data information; each piece of the first to-be-processed data information corresponds to one piece of the to-be-processed read data information one by one.

[0011] The second processing module is configured to perform data loading processing on the first read information to obtain target read information; the target read information includes the N pieces of target read data information; each piece of the target read data information includes at least one piece of target loaded data information.

[0012] A third aspect of the present invention discloses another data processing device for high-frequency reading and writing, the device includes:

[0013] A memory storing executable program code;

[0014] A processor coupled to the memory;

[0015] The processor calls the executable program code stored in the memory and executes some or all of the steps in the data processing method for high-frequency reading and writing disclosed in the first aspect of the embodiments of the present invention.

[0016] A fourth aspect of the present invention discloses a computer-readable storage medium, the computer-readable storage medium stores computer instructions, and when the computer instructions are called, they are used to execute some or all of the steps in the data processing method for high-frequency reading and writing disclosed in the first aspect of the embodiments of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0018] Figure 1 It is a schematic diagram of the scenario of the data processing system for high-frequency reading and writing provided by the embodiments of the present invention;

[0019] Figure 2 It is a schematic flowchart of a data processing method for high-frequency reading and writing disclosed in the embodiments of the present invention;

[0020] Figure 3 It is a schematic structural diagram of a data processing device for high-frequency reading and writing disclosed in the embodiments of the present invention;

[0021] Figure 4It is a schematic structural diagram of another data processing device for high-frequency reading and writing disclosed in an embodiment of the present invention. Detailed implementation manners

[0022] In order to enable those skilled in the art to better understand the solution of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative efforts belong to the scope of protection of the present invention.

[0023] The terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, device, product or equipment that includes a series of steps or units is not limited to the listed steps or units, but optionally further includes steps or units not listed, or optionally further includes other steps or units inherent to these processes, methods, products or equipment.

[0024] Referring to "embodiment" herein means that a specific feature, structure or characteristic described in connection with the embodiment can be included in at least one embodiment of the present invention. The phrase appears in various places in the specification and does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment mutually exclusive with other embodiments. Those skilled in the art will explicitly and implicitly understand that the embodiments described herein can be combined with other embodiments.

[0025] In this application, the word "exemplary" is used to mean "serving as an example, illustration, or description". Any embodiment described as "exemplary" in this application is not necessarily to be construed as more preferred or more advantageous than other embodiments. In order for any person skilled in the art to implement and use this application, the following description is given. Details are set forth in the following description for purposes of explanation. It should be understood that those of ordinary skill in the art can recognize that this application can be implemented without these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid obscuring the description of this application with unnecessary details. Therefore, this application is not intended to be limited to the embodiments shown, but is to be accorded the widest scope consistent with the principles and features disclosed herein.

[0026] It should be noted that since the method of the embodiment of the present application is executed in a computer device, the processing objects of each computer device exist in the form of data or information. For example, time, which is actually time information. It can be understood that in subsequent embodiments, if dimensions, quantities, positions, etc. are mentioned, they are all corresponding data existences for the computer device to process, and specific details will not be elaborated here.

[0027] It should be noted that a brief introduction to the artificial intelligence-related technologies that may be involved in the present application is provided. Artificial Intelligence (AI) is the theory, method, technology, and application system that uses digital computers or machines controlled by digital computers to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new intelligent machine that can respond in a way similar to human intelligence. Artificial intelligence also studies the design principles and implementation methods of various intelligent machines to enable the machines to have the functions of perception, reasoning, and decision-making.

[0028] Artificial intelligence technology is an interdisciplinary subject with a wide range of fields, including both hardware-level technologies and software-level technologies. The basic technologies of artificial intelligence generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, and mechatronics. The software technologies of artificial intelligence mainly include several major directions such as computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0029] Computer Vision Technology (CV) Computer vision is a science that studies how to enable machines to "see". Further, it refers to using cameras and computers to replace human eyes to identify and measure targets, etc., for machine vision, and further perform graphic processing to make the computer-processed images more suitable for human eyes to observe or be transmitted to instruments for detection. As a scientific discipline, computer vision studies related theories and technologies and attempts to establish an artificial intelligence system that can obtain information from images or multi-dimensional data. Computer vision technology usually includes technologies such as image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, etc., and also includes common biometric recognition technologies such as face recognition and fingerprint recognition.

[0030] The unimodal information is data of only one type, such as one of the data information like text, image, audio, video, electromagnetic signal, etc. The multimodal information is data information that includes at least two types of unimodal information. Further, the multimodal information is applicable to complex tasks that require integrating multiple information sources, such as sentiment analysis, robot interaction, autonomous driving, etc. By integrating information of multiple modalities, higher performance and accuracy can usually be achieved in tasks.

[0031] A large model refers to an artificial neural network model with a very large number of parameters. In the field of artificial intelligence, a large model usually refers to a model with hundreds of millions to trillions of parameters. The model usually needs to be trained on a large-scale dataset and requires a large amount of computing resources for optimization and adjustment. Large models are usually used to solve complex natural language processing, computer vision, speech recognition and other tasks. Generative AI is a type of AI that can create new content and ideas, including conversations, stories, images, videos and music. In the embodiments of this application, the large model can be large language models such as ChatGPT, BERT, XLNet, Zhipu Model, Claude, Moonshot AI Model, ChatGLM Model, Qianyitongwen Model, MiniMax Model, Spark Model, Llama Model, 360GPT Model, Qwen Model, Baichuan Model, Lark Model, vivoLM Model and Wenxin Yiyan, and the embodiments of this application do not make limitations.

[0032] The embodiments of this application provide a data processing method, device, computer device and computer-readable storage medium for high-frequency reading and writing, which will be described in detail below respectively.

[0033] Please refer to Figure 1 , Figure 1 which is a schematic diagram of the scenario of the data processing system for high-frequency reading and writing provided by the embodiments of this application. The data processing system for high-frequency reading and writing may include a computer device 100, and a data processing device for high-frequency reading and writing is integrated in the computer device 100, such as Figure 1 the computer device in

[0034] In the embodiments of this application, the computer device 100 is mainly used to obtain the to-be-processed read information; the to-be-processed read information includes M to-be-processed read data information; the to-be-processed read data information includes data priority, read identification information and read resource consumption information;

[0035] Classify the to-be-processed read information to obtain the first read information; the first read information includes N first read data information; each first read data information includes at least one first to-be-processed data information; each first to-be-processed data information corresponds to a to-be-processed read data information one by one;

[0036] Perform data loading processing on the first read information to obtain target read information; the target read information includes N target read data information; each target read data information includes at least one target loaded data information.

[0037] It can improve the high-frequency data reading and writing speed and reliability, and thus effectively meet the high-frequency data reading and writing requirements.

[0038] In the embodiment of the present application, the computer device 100 can be an independent server, or a server network or server cluster composed of servers. For example, the computer device 100 described in the embodiment of the present application includes, but is not limited to, a computer, a network host, a single network server, a set of multiple network servers, or a cloud server composed of multiple servers. Among them, the cloud server is composed of a large number of computers or network servers based on cloud computing.

[0039] It can be understood that the computer device 100 used in the embodiment of the present application can be a device that includes both receiving and transmitting hardware, that is, a device that has receiving and transmitting hardware capable of performing two-way communication on a two-way communication link. Such devices can include: cellular or other communication devices, which have a single-line display or a multi-line display or a cellular or other communication device without a multi-line display. Specifically, the computer device 100 can be a desktop terminal or a mobile terminal, and the computer device 100 can specifically also be one of a mobile phone, a tablet computer, a notebook computer, etc.

[0040] Those skilled in the art can understand that Figure 1 The application environment shown in Figure 1 is only one application scenario of the solution of the present application, and does not constitute a limitation on the application scenario of the solution of the present application. Other application environments can also include more or fewer computer devices than Figure 1 shown in

[0041] In addition, as Figure 1 shown, the data processing system for high-frequency reading and writing can also include a memory 200 for storing data, such as image data, location information, etc.

[0042] It should be noted that Figure 1The schematic diagram of the scenario of the data processing system for high-frequency reading and writing shown is only an example. The data processing system and scenario for high-frequency reading and writing described in the embodiments of this application are for more clearly explaining the technical solutions of the embodiments of this application, and do not constitute a limitation on the technical solutions provided by the embodiments of this application. Those skilled in the art know that with the evolution of the data processing system for high-frequency reading and writing and the emergence of new business scenarios, the technical solutions provided by the embodiments of this application are equally applicable to similar technical problems.

[0043] The present invention discloses a data processing method and device for high-frequency reading and writing, which are beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meeting the high-frequency data reading and writing requirements. The following will be described in detail respectively.

[0044] Embodiment 1

[0045] Please refer to Figure 2 , Figure 2 which is a schematic flowchart of a data processing method for high-frequency reading and writing disclosed in an embodiment of the present invention. Among them, Figure 2 the described data processing method for high-frequency reading and writing is applied to a management system, such as a local server or a cloud server for management, etc., and the embodiments of the present invention do not make limitations. As Figure 2 shown, the data processing method for high-frequency reading and writing may include the following operations:

[0046] 101. Obtain the to-be-processed read information.

[0047] In the embodiments of the present invention, the to-be-processed read information includes M pieces of to-be-processed read data information; the to-be-processed read data information includes data priority, read identification information, and read resource consumption information.

[0048] 102. Classify the to-be-processed read information to obtain the first read information.

[0049] In the embodiments of the present invention, the first read information includes N pieces of first read data information; each piece of first read data information includes at least one piece of first to-be-processed data information; each piece of first to-be-processed data information corresponds to one piece of to-be-processed read data information one by one.

[0050] 103. Perform data loading processing on the first read information to obtain the target read information.

[0051] In the embodiments of the present invention, the target read information includes N pieces of target read data information; each piece of target read data information includes at least one piece of target loaded data information.

[0052] It should be noted that the data processing method for high-frequency reading and writing in this application can significantly improve the speed of high-frequency reading and writing operations and the system response ability, and through data compression, priority management, and fault recovery mechanisms, ensure the integrity and reliability of data in high-frequency reading and writing operations. This method is applicable to fields with high demands for high-frequency reading and writing such as finance, real-time analysis, and the Internet of Things, that is, it can be deployed in scenarios such as real-time data processing systems or Internet of Things management platforms to improve their data reading and writing efficiency. The embodiments of the present invention are not limited in this regard.

[0053] It should be noted that after obtaining the to-be-processed read information, this application also has a fault recovery mechanism. That is, in high-frequency reading and writing operations, the risk of data loss or damage increases. This application introduces data redundancy and logging mechanisms. Once a fault occurs, the system can automatically recover to the state before the fault, ensuring data integrity and consistency. The logging module will record each write operation in detail to ensure that in the event of an unexpected power outage or system crash, data rollback or reconstruction can be performed to ensure the integrity and reliability of data in high-frequency reading and writing operations. The embodiments of the present invention are not limited in this regard.

[0054] It should be noted that the system based on the method of this application is configured with a high-performance multi-core processor, multi-level caches, and high-speed storage media to ensure that the hardware foundation can support high-frequency reading and writing operations. The system can be deployed in scenarios such as real-time data processing systems or Internet of Things management platforms to improve their data reading and writing efficiency. The embodiments of the present invention are not limited in this regard.

[0055] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiments of the present invention is beneficial to improving the speed and reliability of high-frequency data reading and writing, and thus effectively meeting the high-frequency data reading and writing requirements.

[0056] In an optional embodiment, the above-mentioned classification processing of the to-be-processed read data information to obtain the first read information includes:

[0057] Sort the to-be-processed read data information in descending order of data priority to obtain a to-be-processed read data sequence;

[0058] Obtain hardware resource information; the hardware resource information includes several available resource information;

[0059] Use the read resource consumption information in the to-be-processed read data information to screen and sort the hardware resource information to obtain a hardware resource sequence;

[0060] Based on the hardware resource sequence and the to-be-processed read data sequence, obtain the first read information.

[0061] It should be noted that the above data priorities set the read and write priorities according to the application scenarios and the importance of the data. For example, the read and write operations of critical data in financial transactions are set to high priority to ensure that they can be processed preferentially. The embodiments of the present invention do not make any limitations in this regard. Further, when obtaining the first read information based on the hardware resource sequence and the data sequence to be read, if the total resources of the processor are insufficient, for low-priority data read and write requests, the system will perform delayed processing when resources are tense to ensure the stability of the overall system. The embodiments of the present invention do not make any limitations in this regard.

[0062] It should be noted that the above available resource information represents the total amount of resources available for the processor to process data, such as at least one of the total amount of resources in physical memory (RAM), virtual memory, processing capabilities (such as the number of CPU cores, frequency), and other hardware resources (such as GPU, storage space), etc. The embodiments of the present invention do not make any limitations in this regard.

[0063] It should be noted that the above process of screening and sorting the hardware resource information by using the read resource consumption information in the data information to be read, and then sequentially selecting an available resource information from the hardware resource sequence as the target available resource information in the subsequent process is to exclude the available resource information whose total amount of resources of the processor is less than the resource consumption corresponding to the read resource consumption information from the hardware resource information, and then sort the available resource information in ascending order of the total amount of resources of the processor to ensure that the processor with the smallest total amount of resources can be preferentially used, thereby improving the utilization efficiency of hardware resources. The embodiments of the present invention do not make any limitations in this regard.

[0064] It can be seen that implementing the data processing method for high-frequency read and write described in the embodiments of the present invention is beneficial to improving the high-frequency data read and write speed and reliability, and thus effectively meeting the high-frequency data read and write requirements.

[0065] In another alternative embodiment, obtaining the first read information based on the hardware resource sequence and the data sequence to be read includes:

[0066] Sequentially selecting an available resource information from the hardware resource sequence as the target available resource information;

[0067] Based on the magnitude relationship between the available resource amount corresponding to the target available resource information and the read resource consumption corresponding to the read resource consumption information, selecting at least one data information to be read from the data sequence to be read as the first data information to be processed corresponding to the first read data information;

[0068] Removing the data information to be read corresponding to the first data information to be processed from the data sequence to be read;

[0069] Determine whether there is pending read data information in the sequence of pending read data to be processed, and obtain a first determination result;

[0070] When the first determination result is yes, determine whether the available resource information corresponding to the target available resource information is the last available resource information in the sequence of hardware resource information, and obtain a second determination result;

[0071] When the second determination result is no, trigger the execution of sequentially selecting an available resource information from the sequence of hardware resource information as the target available resource information;

[0072] When the second determination result is yes, trigger the execution of performing data loading processing on the first read information to obtain the target read information;

[0073] When the first determination result is no, trigger the execution of performing data loading processing on the first read information to obtain the target read information.

[0074] It should be noted that, based on the magnitude relationship between the available resource amount corresponding to the target available resource information and the read resource consumption amount corresponding to the read resource consumption information, selecting at least one piece of pending read data information from the sequence of pending read data as the first pending data information corresponding to the first read data information is determined according to the number of read resource consumption information that can be processed by the available resource amount corresponding to each hardware device. The embodiments of the present invention do not make any limitations. For example, when the available resource amount is 2 resource units and the read resource consumption amount is 1 resource unit, it means that the available resource amount corresponding to the target available resource information can process 2 pieces of pending read data information. Then, there are 2 pieces of pending read data information for the first pending data information corresponding to the first read data information. The embodiments of the present invention do not make any limitations. Further, the number of the above available resource amounts is rounded down. For example, when the available resource amount is 3.5 resource units, it is only regarded as 3 resource units. The embodiments of the present invention do not make any limitations.

[0075] It should be noted that, removing the pending read data information corresponding to the first pending data information from the sequence of pending read data excludes the pending read data information that has been allocated to the hardware device, so as to ensure that the pending read data information will not be repeatedly loaded and read, thereby improving the efficiency and accuracy of data reading. The embodiments of the present invention do not make any limitations.

[0076] It should be noted that the above determination of whether there is data reading information to be processed in the data sequence to be processed is to analyze and determine whether there is still data reading information to be processed that requires data reading and writing. Further, the determination of whether the available resource information corresponding to the target available resource information is the last available resource information in the hardware resource sequence is based on the premise that there is data reading information to be processed that has not been allocated hardware resources. Further, it is analyzed whether there are available hardware resources to ensure that the data reading information to be processed can be effectively read and written, thereby improving the efficiency and reliability of high-frequency data reading and writing. The embodiments of the present invention do not make any limitations in this regard.

[0077] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiments of the present invention is beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meeting the high-frequency data reading and writing requirements.

[0078] In another optional embodiment, performing data loading processing on the first reading information to obtain target reading information includes:

[0079] For any first reading data information in the first reading information, for any first data information to be processed in the first reading data information, loading the stored data information matching the first data information to be processed from the data buffer to obtain the first loaded data information corresponding to the first data information to be processed; the data buffer includes a first buffer, a second buffer, and a third buffer; the data reading speeds of the first buffer, the second buffer, and the third buffer decrease in sequence; the stored data information includes several first stored data information stored in the first buffer, several second stored data information stored in the second buffer, and several third stored data information stored in the third buffer;

[0080] Performing parsing processing on the first loaded data information to obtain the target loaded data information corresponding to the first data information to be processed.

[0081] It should be noted that the data buffer of the present application is constructed using a multi-level cache mechanism. Further, the above-mentioned first buffer, second buffer, and third buffer respectively correspond to a high-speed cache (such as SRAM), a medium-speed cache (such as DRAM), and a persistent cache (such as SSD). Further, loading the stored data information matching the first data information to be processed from the data buffer is to preferentially load and read data from the buffer with a fast data reading speed, that is, high-frequency reading and writing requests are preferentially processed in the high-speed cache, and unhit requests will be searched in the medium-speed cache and the persistent cache in sequence, thereby improving the efficiency of data loading and reading and writing. The embodiments of the present invention do not make any limitations in this regard.

[0082] In this optional embodiment, as an optional implementation manner, the above-mentioned first stored data information is updated based on the following method:

[0083] For any first stored data information, obtain the usage frequency and the most recent usage time corresponding to the first stored data information;

[0084] Respectively use the frequency quantization table and the time quantization table to perform look-up quantization processing on the usage frequency and the most recent usage time corresponding to the first stored data information, to obtain a first quantization value and a second quantization value;

[0085] Use a quantization calculation model to perform calculation processing on the first quantization value and the second quantization value, to obtain a target quantization value;

[0086] Wherein, the quantization calculation model is:

[0087] Target quantization value = first quantization coefficient * first quantization value + first quantization coefficient * second quantization value;

[0088] Judge whether the target quantization value is greater than a first quantization threshold, to obtain a first quantization judgment result;

[0089] When the first quantization judgment result is negative, judge whether the target quantization value is greater than a second quantization threshold, to obtain a second quantization judgment result;

[0090] When the second quantization judgment result is positive, determine the first stored data information as a new second stored data information;

[0091] When the second quantization judgment result is negative, determine the first stored data information as a new third stored data information;

[0092] When the first quantization judgment result is positive, end determining the first stored data information as a new first stored data information.

[0093] Further, when the first stored data information is updated, if the update of the first stored data information is not the first stored data information, delete the first stored data information from the first buffer area, which is not limited in the embodiments of the present invention.

[0094] It should be noted that the update methods of the above-mentioned second stored data information and third stored data information are the same as those of the first stored data information, which are not limited in the embodiments of the present invention.

[0095] It should be noted that the above-mentioned first quantization threshold can be set by the user, or can be a default value given by the system, or can be obtained by averaging historical first quantization thresholds, which is not limited in the embodiments of the present invention. Further, the first quantization threshold is greater than the second quantization threshold and greater than 0, which is not limited in the embodiments of the present invention.

[0096] It should be noted that the above-mentioned second quantization threshold can be set by the user, or can be the default value given by the system, or can be obtained by averaging the historical second quantization thresholds. The embodiments of the present invention do not make any limitations. Further, the second quantization threshold is greater than 0, and the embodiments of the present invention do not make any limitations.

[0097] It should be noted that the above-mentioned first quantization coefficient and second quantization coefficient are values between [0, 1], and the embodiments of the present invention do not make any limitations.

[0098] It should be noted that the above-mentioned usage frequency and the most recent usage time respectively represent the frequency of reading and writing the stored data information within an update time unit and the time of the most recent reading and writing. The embodiments of the present invention do not make any limitations. Further, the above-mentioned update time unit can be 1h, 1 day, 1 week, etc., and the embodiments of the present invention do not make any limitations.

[0099] It should be noted that the above-mentioned frequency quantization table and time quantization table can be respectively:

[0100] Usage frequency Quantization value (0,10] 1 (10,20] 2 (20,30] 3 >30 4

[0101] Most recent usage time (update time unit) Quantization value (0,0.1] 5 (0.1,0.3] 4 (0.3,0.5] 3 >0.5 1

[0102] It should be noted that the above-mentioned update of the stored data information is a dynamic cache replacement strategy adopted to reduce the reduction of the cache hit rate, and the cache content is dynamically adjusted according to the data access frequency and the most recent usage time. The embodiments of the present invention do not make any limitations.

[0103] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiments of the present invention is beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meets the high-frequency data reading and writing requirements.

[0104] In yet another alternative embodiment, loading the stored data information matching the first data information to be processed from the data buffer area to obtain the first loaded data information corresponding to the first data information to be processed includes:

[0105] Performing calculation processing on the first stored data information and the first data information to be processed by using a matching calculation model to obtain first matching value information; the first matching value information includes a plurality of first matching values;

[0106] Among them, the matching calculation model is:

[0107]

[0108] In the formula, DYPPZ represents the first matching value; A represents the first stored data information; B represents the first data information to be processed; aa and bb respectively represent the first matching coefficient and the second matching coefficient;

[0109] Determine whether there is a first matching value greater than or equal to the matching threshold in the first matching value information to obtain a first matching judgment result;

[0110] When the first matching judgment result is yes, determine the first stored data information corresponding to the first matching value greater than or equal to the matching threshold as the first loaded data information corresponding to the first data to be processed;

[0111] When the first matching judgment result is no, determine a second matching value information based on the matching calculation model and the second stored data information; the second matching value information includes a plurality of second matching values;

[0112] Determine whether there is a second matching value greater than or equal to the matching threshold in the second matching value information to obtain a second matching judgment result;

[0113] When the second matching judgment result is yes, determine the second stored data information corresponding to the second matching value greater than or equal to the matching threshold as the first loaded data information corresponding to the first data to be processed;

[0114] When the second matching judgment result is yes, determine the first loaded data information corresponding to the first data to be processed based on the matching calculation model and the third stored data information.

[0115] It should be noted that the above first stored data information and the first data to be processed can be represented in the form of vectors, which is not limited in the embodiments of the present invention.

[0116] It should be noted that the above first matching coefficient and the second matching coefficient are numerical values in [0,1], which are not limited in the embodiments of the present invention.

[0117] It should be noted that the above matching threshold can be set by the user, or can be a default value given by the system, or can be determined by taking the average of historical matching thresholds, which is not limited in the embodiments of the present invention. Further, it is a positive number greater than 1, which is not limited in the embodiments of the present invention.

[0118] It should be noted that the above first matching value represents the correlation between the first stored data information and the first data to be processed. When the first matching value is greater than or equal to the matching threshold, it represents that the first stored data information is the data information that the first data to be processed needs to load, which is not limited in the embodiments of the present invention.

[0119] It should be noted that the method for determining the second matching value information based on the matching calculation model and the second stored data information, and the method for determining the first loaded data information corresponding to the first data to be processed based on the matching calculation model and the third stored data information are consistent with the method for calculating and processing the first stored data information using the matching calculation model, and the embodiments of the present invention do not make any limitations in this regard.

[0120] It should be noted that the above parsing and processing of the first loaded data information is carried out during the process of rapid data reading and writing, reducing the time and storage space consumption of data transmission in high-frequency reading and writing operations, and not introducing obvious performance overhead during the data reading and writing process. The embodiments of the present invention do not make any limitations in this regard.

[0121] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiments of the present invention is beneficial to improving the speed and reliability of high-frequency data reading and writing, and thus effectively meeting the requirements of high-frequency data reading and writing.

[0122] In an alternative embodiment, the above parsing and processing of the first loaded data information to obtain the target loaded data information corresponding to the first data to be processed includes:

[0123] Performing segmentation processing on the first loaded data information to obtain a number of sequentially distributed segmented data information; the segmented data information includes a frame header information and character information;

[0124] For any segmented data information, performing parsing processing on the frame header information of the segmented data information to obtain a first parsing length value and a second parsing length value;

[0125] Sequentially selecting, from left to right, a number of characters in the character information corresponding to the segmented data information that is consistent with the first parsing length value as the first parsed character information corresponding to the segmented data information;

[0126] Performing conversion processing on the first parsed character information to obtain the first target character information corresponding to the segmented data information;

[0127] Sequentially selecting, from left to right, a number of characters in the character information corresponding to the segmented data information that is consistent with the second parsing length value as the second parsed character information corresponding to the segmented data information;

[0128] Performing conversion processing on the second parsed character information to obtain the second target character information corresponding to the segmented data information;

[0129] Performing splicing processing on the first target character information and the second target character information to obtain the target parsed data information corresponding to the segmented data information;

[0130] Based on the positional sequence relationship of the segmented data information, the target parsed data information corresponding to all the segmented data information is concatenated to obtain the target loaded data information corresponding to the first data to be processed.

[0131] It should be noted that the above splitting process of the first loaded data information is performed according to the delimiter (such as "-" etc.) in the frame header information, that is, the data between two delimiters is determined as a segmented data information, which is not limited in the embodiments of the present invention.

[0132] It should be noted that the above character information is data represented in decimal, which is not limited in the embodiments of the present invention. Further, the characters with the same number as the second parsing length value are sequentially selected from left to right from the character information corresponding to the segmented data information as the second parsing character information corresponding to the segmented data information, which is to select the valid character information in the segmented data information, thereby ensuring the effectiveness and reliability of data loading and reading, which is not limited in the embodiments of the present invention. Further, the above process of sequentially selecting the characters with the same number as the second parsing length value from left to right from the character information corresponding to the segmented data information as the second parsing character information corresponding to the segmented data information is to perform secondary loading on the repeated data. Mainly, the data form in this application is in the form of XY, where Y is a partial content of X, which is not limited in the embodiments of the present invention.

[0133] It should be noted that the above process of converting the first parsing character information and converting the second parsing character information is to convert decimal data into a string, which is not limited in the embodiments of the present invention.

[0134] It should be noted that the above process of concatenating the first target character information and the second target character information is to concatenate the second target character information after the first target character information, which is not limited in the embodiments of the present invention.

[0135] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiments of the present invention is beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meeting the high-frequency data reading and writing requirements.

[0136] In another optional embodiment, parsing the frame header information of the segmented data information to obtain a first parsing length value and a second parsing length value includes:

[0137] Performing binary conversion processing on the frame header information of the segmented data information to obtain segmented conversion information;

[0138] Perform segmentation processing on the segmented conversion information to obtain first segmented conversion information, second segmented conversion information, and third segmented conversion information; the second segmented conversion information represents the last two data information in the segmented conversion information; the third segmented conversion information represents the third and fourth data information from the bottom in the segmented conversion information;

[0139] Perform decimal conversion processing on the first segmented conversion information to obtain a first parsing length value;

[0140] Perform decimal conversion processing on the second segmented conversion information and the third segmented conversion information respectively to obtain a first standby length value and a second standby length value;

[0141] Perform a summation calculation on the first standby length value and the second standby length value to obtain a second parsing length value.

[0142] It should be noted that the above binary conversion processing of the frame header information of the segmented data information is to convert decimal data into binary data to realize the conversion of short decimal data into long-byte binary data information, which is not limited in the embodiments of the present invention.

[0143] It should be noted that the above segmentation processing of the segmented conversion information is to orderly segment the binary information storing position information, so as to obtain the positions and quantities of the decimal data corresponding to the first target character information and the second target character information, for subsequent decryption and parsing processing, so as to improve the data reading efficiency while ensuring data security, which is not limited in the embodiments of the present invention.

[0144] It should be noted that the above decimal conversion processing of the first segmented conversion information and the decimal conversion processing of the second segmented conversion information and the third segmented conversion information respectively are to realize the decimal conversion for natural language understanding, so as to realize the positioning according to the position of the decimal data and effectively improve the data loading and reading and writing efficiency, which is not limited in the embodiments of the present invention.

[0145] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiments of the present invention is beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meeting the high-frequency data reading and writing requirements.

[0146] Embodiment 2

[0147] Please refer to Figure 3 , Figure 3 which is a schematic structural diagram of a data processing device for high-frequency reading and writing disclosed in the embodiments of the present invention. Among them, Figure 3 the described device can be applied to a management system, such as a local server or a cloud server for management, etc., which is not limited in the embodiments of the present invention. As Figure 3 shown, the device may include:

[0148] An acquisition module 201, configured to acquire information to be processed for reading; the information to be processed for reading includes M pieces of information to be processed for reading data; the information to be processed for reading data includes data priority, reading identification information, and reading resource consumption information;

[0149] A first processing module 202, configured to classify and process the information to be processed for reading to obtain first reading information; the first reading information includes N pieces of first reading data information; each piece of first reading data information includes at least one piece of first data to be processed information; each piece of first data to be processed information corresponds to one piece of information to be processed for reading data;

[0150] A second processing module 203, configured to perform data loading processing on the first reading information to obtain target reading information; the target reading information includes N pieces of target reading data information; each piece of target reading data information includes at least one piece of target loaded data information.

[0151] It can be seen that implementing Figure 3 the described data processing device for high-frequency reading and writing is beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meeting the high-frequency data reading and writing requirements.

[0152] In another optional embodiment, as Figure 3 shown, the first processing module 202 classifies and processes the information to be processed for reading data to obtain first reading information, including:

[0153] Sorting the information to be processed for reading data in descending order according to the data priority to obtain a sequence of information to be processed for reading data;

[0154] Acquiring hardware resource information; the hardware resource information includes several available resource information;

[0155] Using the reading resource consumption information in the information to be processed for reading data to screen and sort the hardware resource information to obtain a hardware resource sequence;

[0156] Based on the hardware resource sequence and the sequence of information to be processed for reading data, obtaining the first reading information.

[0157] It can be seen that implementing Figure 3 the described data processing device for high-frequency reading and writing is beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meeting the high-frequency data reading and writing requirements.

[0158] In yet another optional embodiment, as Figure 3 shown, the first processing module 202 obtains the first reading information based on the hardware resource sequence and the sequence of information to be processed for reading data, including:

[0159] Select an available resource information from the hardware resource sequence in sequence as the target available resource information;

[0160] Based on the magnitude relationship between the available resource amount corresponding to the target available resource information and the read resource consumption amount corresponding to the read resource consumption information, select at least one to-be-processed read data information from the to-be-processed read data sequence as the first to-be-processed data information corresponding to the first read data information;

[0161] Remove the to-be-processed read data information corresponding to the first to-be-processed data information from the to-be-processed read data sequence;

[0162] Determine whether there is to-be-processed read data information in the to-be-processed read data sequence, and obtain a first determination result;

[0163] When the first determination result is yes, determine whether the available resource information corresponding to the target available resource information is the last available resource information in the hardware resource sequence, and obtain a second determination result;

[0164] When the second determination result is no, trigger the execution of selecting an available resource information from the hardware resource sequence in sequence as the target available resource information;

[0165] When the second determination result is yes, trigger the execution of performing data loading processing on the first read information to obtain the target read information;

[0166] When the first determination result is no, trigger the execution of performing data loading processing on the first read information to obtain the target read information.

[0167] It can be seen that implementing Figure 3 the described data processing device for high-frequency reading and writing is beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meeting the high-frequency data reading and writing requirements.

[0168] In another optional embodiment, as Figure 3 shown, the second processing module 203 performs data loading processing on the first read information to obtain the target read information, including:

[0169] For any first read data information in the first read information, for any first to-be-processed data information in the first read data information, load the stored data information matching the first to-be-processed data information from the data buffer to obtain the first loaded data information corresponding to the first to-be-processed data information; the data buffer includes a first buffer, a second buffer, and a third buffer; the data reading speeds of the first buffer, the second buffer, and the third buffer decrease in sequence; the stored data information includes several first stored data information stored in the first buffer, several second stored data information stored in the second buffer, and several third stored data information stored in the third buffer;

[0170] Parse and process the first load data information to obtain the target load data information corresponding to the first data information to be processed.

[0171] It can be seen that implementing Figure 3 the described data processing device for high-frequency reading and writing is beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meeting the high-frequency data reading and writing requirements.

[0172] In another optional embodiment, as Figure 3 shown, the second processing module 203 loads the stored data information matching the first data information to be processed from the data buffer to obtain the first load data information corresponding to the first data information to be processed, including:

[0173] Perform calculation processing on the first stored data information and the first data information to be processed using a matching calculation model to obtain first matching value information; the first matching value information includes a plurality of first matching values;

[0174] Among them, the matching calculation model is:

[0175]

[0176] In the formula, DYPPZ represents the first matching value; A represents the first stored data information; B represents the first data information to be processed; aa and bb respectively represent the first matching coefficient and the second matching coefficient;

[0177] Judge whether there is a first matching value greater than or equal to the matching threshold in the first matching value information to obtain a first matching judgment result;

[0178] When the first matching judgment result is yes, determine the first stored data information corresponding to the first matching value greater than or equal to the matching threshold as the first load data information corresponding to the first data information to be processed;

[0179] When the first matching judgment result is no, determine second matching value information based on the matching calculation model and the second stored data information; the second matching value information includes a plurality of second matching values;

[0180] Judge whether there is a second matching value greater than or equal to the matching threshold in the second matching value information to obtain a second matching judgment result;

[0181] When the second matching judgment result is yes, determine the second stored data information corresponding to the second matching value greater than or equal to the matching threshold as the first load data information corresponding to the first data information to be processed;

[0182] When the second matching judgment result is positive, based on the matching calculation model and the third stored data information, determine the first loaded data information corresponding to the first data information to be processed.

[0183] It can be seen that implementing Figure 3 the described data processing device for high-frequency reading and writing is beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meeting the high-frequency data reading and writing requirements.

[0184] In another alternative embodiment, as Figure 3 shown, the second processing module 203 performs parsing processing on the first loaded data information to obtain the target loaded data information corresponding to the first data information to be processed, including:

[0185] Perform segmentation processing on the first loaded data information to obtain a number of sequentially distributed segmented data information; the segmented data information includes a frame header information and character information;

[0186] For any segmented data information, perform parsing processing on the frame header information of the segmented data information to obtain a first parsing length value and a second parsing length value;

[0187] Select, from left to right in the character information corresponding to the segmented data information, the same number of characters as the first parsing length value as the first parsed character information corresponding to the segmented data information;

[0188] Perform conversion processing on the first parsed character information to obtain the first target character information corresponding to the segmented data information;

[0189] Select, from left to right in the character information corresponding to the segmented data information, the same number of characters as the second parsing length value as the second parsed character information corresponding to the segmented data information;

[0190] Perform conversion processing on the second parsed character information to obtain the second target character information corresponding to the segmented data information;

[0191] Perform splicing processing on the first target character information and the second target character information to obtain the target parsed data information corresponding to the segmented data information;

[0192] Based on the positional order relationship of the segmented data information, perform splicing processing on the target parsed data information corresponding to all segmented data information to obtain the target loaded data information corresponding to the first data information to be processed.

[0193] It can be seen that implementing Figure 3 the described data processing device for high-frequency reading and writing is beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meeting the high-frequency data reading and writing requirements.

[0194] In yet another alternative embodiment, as Figure 3 shown, the second processing module 203 parses the framed header information of the segmented data information to obtain a first parsing length value and a second parsing length value, including:

[0195] Perform binary conversion processing on the framed header information of the segmented data information to obtain segmented conversion information;

[0196] Perform segmentation processing on the segmented conversion information to obtain first segmented conversion information, second segmented conversion information, and third segmented conversion information; the second segmented conversion information represents the last two data information in the segmented conversion information; the third segmented conversion information represents the third and fourth data information from the bottom in the segmented conversion information;

[0197] Perform decimal conversion processing on the first segmented conversion information to obtain a first parsing length value;

[0198] Perform decimal conversion processing on the second segmented conversion information and the third segmented conversion information respectively to obtain a first standby length value and a second standby length value;

[0199] Perform a summation calculation on the first standby length value and the second standby length value to obtain a second parsing length value.

[0200] It can be seen that implementing Figure 3 the data processing device for high-frequency reading and writing described is beneficial to improving the high-frequency data reading and writing speed and reliability, and thus effectively meeting the high-frequency data reading and writing requirements.

[0201] Embodiment III

[0202] Please refer to Figure 4 , Figure 4 which is a schematic structural diagram of another data processing device for high-frequency reading and writing disclosed in an embodiment of the present invention. Among them, Figure 4 the described device can be applied to a management system, such as a local server or a cloud server for management, etc., which is not limited in the embodiments of the present invention. As Figure 4 shown, the device may include:

[0203] A memory 301 storing executable program code;

[0204] A processor 302 coupled to the memory 301;

[0205] The processor 302 calls the executable program code stored in the memory 301 to execute the steps in the data processing method for high-frequency reading and writing described in Embodiment I.

[0206] Embodiment IV

[0207] An embodiment of the present invention discloses a computer-readable storage medium that stores a computer program for electronic data exchange. The computer program causes a computer to execute the steps in the data processing method for high-frequency reading and writing described in Embodiment 1.

[0208] Embodiment 5

[0209] An embodiment of the present invention discloses a computer program product. The computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute the steps in the data processing method for high-frequency reading and writing described in Embodiment 1.

[0210] The device embodiments described above are merely illustrative. The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed to multiple network modules. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative effort.

[0211] Through the above specific description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus a necessary general hardware platform, and of course, it can also be implemented by hardware. Based on such an understanding, the above technical solution, in essence, or the part that contributes to the prior art, can be embodied in the form of a software product. The computer software product can be stored in a computer-readable storage medium, including a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electrically-erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc memories, a magnetic disk memory, a tape memory, or any other computer-readable medium capable of carrying or storing data.

[0212] Finally, it should be noted that: The data processing method and device for high-frequency reading and writing disclosed in the embodiments of the present invention only disclose the preferred embodiments of the present invention, and are only used to illustrate the technical solutions of the present invention, rather than limiting them; Although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements for some of the technical features; And these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A data processing method for high-frequency reading and writing, characterized in that: The method comprises: Acquire the read information to be processed; the read information to be processed includes M read data information to be processed; the read data information to be processed includes data priority, read identification information and read resource consumption information; Classify and process the read information to be processed to obtain first read information; the first read information includes N first read data information; each of the first read data information includes at least one first data information to be processed; each of the first data information to be processed corresponds to one of the read data information to be processed; The first read information is subjected to data loading processing to obtain target read information; the target read information includes the N target read data information; each of the target read data information includes at least one target loading data information.

2. The data processing method for high-frequency reading and writing according to claim 1, characterized in that: The classifying and processing the to-be-processed read data information to obtain first read information includes: Sort the data priorities of the to-be-processed read data information from high to low to obtain a to-be-processed read data sequence; Acquire hardware resource information; the hardware resource information includes a plurality of available resource information; Using the read resource consumption information in the read data information to be processed, the hardware resource information is screened and sorted to obtain a hardware resource sequence; Based on the hardware resource sequence and the to-be-processed read data sequence, first read information is obtained.

3. The data processing method for high-frequency reading and writing according to claim 2, characterized in that: The obtaining first read information based on the hardware resource sequence and the sequence of read data to be processed includes: Sequentially selecting one of the available resource information from the hardware resource sequence as target available resource information; Based on the relationship between the available resource amount corresponding to the target available resource information and the read resource consumption amount corresponding to the read resource consumption information, selecting at least one of the to-be-processed read data information from the to-be-processed read data sequence as the first to-be-processed data information corresponding to the first read data information; Eliminate the to-be-processed read data information corresponding to the first to-be-processed data information from the to-be-processed read data sequence; Determine whether the to-be-processed read data information exists in the to-be-processed read data sequence, and obtain a first determination result; When the first judgment result is yes, judging whether the available resource information corresponding to the target available resource information is the last available resource information in the hardware resource sequence, and obtaining a second judgment result; When the second judgment result is no, triggering the execution of sequentially selecting one of the available resource information from the hardware resource sequence as the target available resource information; When the second judgment result is yes, triggering the execution of the data loading process on the first read information to obtain the target read information; When the first judgment result is no, the data loading process for the first read information is triggered to obtain target read information.

4. The data processing method for high-frequency reading and writing according to claim 1, characterized in that: The performing data loading processing on the first read information to obtain target read information includes: For any of the first read data information in the first read information, and for any of the first to-be-processed data information in the first read data information, load the storage data information matching the first to-be-processed data information from the data cache area to obtain the first loaded data information corresponding to the first to-be-processed data information; the data cache area includes a first cache area, a second cache area, and a third cache area; the data reading speeds of the first cache area, the second cache area, and the third cache area decrease in sequence; the storage data information includes a plurality of first storage data information stored in the first cache area, a plurality of second storage data information stored in the second cache area, and a plurality of third storage data information stored in the third cache area; The first loaded data information is parsed and processed to obtain target loaded data information corresponding to the first data information to be processed.

5. The data processing method for high-frequency reading and writing according to claim 4, characterized in that: The step of loading stored data information matching the first data information to be processed from the data cache area to obtain first loaded data information corresponding to the first data information to be processed includes: Using a matching calculation model to calculate and process the first stored data information and the first data information to be processed, to obtain first matching value information; the first matching value information includes a plurality of first matching values; Among them, the matching calculation model is: In the formula, DYPPZ represents the first matching value; A represents the first stored data information; B represents the first data information to be processed; aa and bb represent the first matching coefficient and the second matching coefficient respectively; Determine whether there is a first matching value greater than or equal to a matching threshold in the first matching value information, and obtain a first matching determination result; When the first match judgment result is yes, determining the first stored data information corresponding to the first match value greater than or equal to the match threshold as the first loaded data information corresponding to the first data information to be processed; When the first matching judgment result is no, second matching value information is determined based on the matching calculation model and the second stored data information; the second matching value information includes a plurality of second matching values; Determine whether there is a second matching value greater than or equal to the matching threshold in the second matching value information, and obtain a second matching determination result; When the second match judgment result is yes, determining the second stored data information corresponding to the second match value that is greater than or equal to the match threshold as the first loaded data information corresponding to the first data information to be processed; When the second matching judgment result is , based on the matching calculation model and the third stored data information, the first loaded data information corresponding to the first data information to be processed is determined.

6. The data processing method for high-frequency reading and writing according to claim 4, characterized in that: The parsing and processing of the first loaded data information to obtain target loaded data information corresponding to the first data information to be processed includes: The first loaded data information is segmented to obtain a plurality of sequentially distributed segmented data information; the segmented data information includes frame header information and character information; For any of the segmented data information, parse the frame header information of the segmented data information to obtain a first parsed length value and a second parsed length value; Selecting characters whose number matches the first parsed length value from the character information corresponding to the segmented data information from left to right as the first parsed character information corresponding to the segmented data information; Performing conversion processing on the first parsed character information to obtain first target character information corresponding to the segmented data information; Selecting characters whose number matches the second parsed length value from the character information corresponding to the segmented data information from left to right as the second parsed character information corresponding to the segmented data information; Performing conversion processing on the second parsed character information to obtain second target character information corresponding to the segmented data information; Performing splicing processing on the first target character information and the second target character information to obtain target parsed data information corresponding to the segmented data information; Based on the position order relationship of the segmented data information, the target parsed data information corresponding to all the segmented data information is spliced ​​to obtain the target loaded data information corresponding to the first data information to be processed.

7. The data processing method for high-frequency reading and writing according to claim 6, characterized in that: The parsing of the frame header information of the segmented data information to obtain a first parsed length value and a second parsed length value includes: Performing binary conversion processing on the frame header information of the segmented data information to obtain segmentation conversion information; The segmentation conversion information is segmented to obtain first segmentation conversion information, second segmentation conversion information and third segmentation conversion information; the second segmentation conversion information represents the last two bits of data information in the segmentation conversion information; the third segmentation conversion information represents the third to last bit and the fourth to last bit of data information in the segmentation conversion information; Performing decimal conversion processing on the first segmentation conversion information to obtain a first parsed length value; Performing decimal conversion processing on the second segmentation conversion information and the third segmentation conversion information respectively to obtain a first standby length value and a second standby length value; The first standby length value and the second standby length value are summed to obtain a second parsed length value.

8. A data processing device for high-frequency reading and writing, characterized in that: The device comprises: An acquisition module, used for acquiring the read information to be processed; the read information to be processed includes M read data information to be processed; the read data information to be processed includes data priority, read identification information and read resource consumption information; A first processing module is used to classify and process the read information to be processed to obtain first read information; the first read information includes N first read data information; each of the first read data information includes at least one first data information to be processed; each of the first data information to be processed corresponds to one of the read data information to be processed; The second processing module is used to perform data loading processing on the first read information to obtain target read information; the target read information includes the N target read data information; each of the target read data information includes at least one target loading data information.

9. A data processing device for high-frequency reading and writing, characterized in that: The device comprises: A memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the data processing method for high-frequency reading and writing as described in any one of claims 1-7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the data processing method for high-frequency reading and writing according to any one of claims 1 to 7.

Images