A data processing method and device for high-frequency reading and writing

Abstract

The present invention discloses a data processing method and device for high-frequency reading and writing, the method comprising: obtaining read information to be processed; the read information to be processed comprises M pieces of read data information to be processed; the read data information to be processed comprises data priority, read identification information and read resource consumption information; classifying and processing the read information to be processed to obtain first read information; the first read information comprises N pieces of first read data information; each piece of first read data information comprises at least one first piece of data information to be processed; each piece of first piece of data information to be processed corresponds one-to-one to one piece of read data information to be processed; performing data loading processing on the first read information to obtain target read information; the target read information comprises N pieces of target read data information; each piece of target read data information comprises at least one target loaded data information.

Description

Technical Field

[0001] The present invention relates to the technical field of data storage and processing, and in particular to a data processing method and device for high-frequency reading and writing. Background Art

[0002] In the big data era, the high-frequency read and write operations of massive amounts of data place extremely high demands on storage system performance. Traditional storage systems often encounter bottlenecks when faced with high-frequency read and write operations, resulting in reduced system response speed and even data loss or corruption. The demand for high-frequency read and write operations is particularly urgent in scenarios such as financial trading systems, real-time data analysis, and IoT device management. Therefore, a data processing method and device for high-frequency read and write operations are provided to improve the speed and reliability of high-frequency data read and write operations, thereby effectively addressing these needs. Summary of the Invention

[0003] The technical problem to be solved by the present invention is to provide a data processing method and device for high-frequency reading and writing, which is conducive to improving the speed and reliability of high-frequency data reading and writing, and thus effectively meeting the needs of high-frequency data reading and writing.

[0004] In order to solve the above technical problems, a first aspect of an embodiment of the present invention discloses a data processing method for high-frequency reading and writing, the method comprising:

[0005] Obtaining pending read information; the pending read information includes M pending read data information; the pending read data information includes data priority, read identification information, and read resource consumption information;

[0006] Classifying and processing the read information to be processed to obtain first read information; the first read information includes N first read data information; each first read data information includes at least one first data information to be processed; each first data information to be processed corresponds one-to-one to one read data information to be processed;

[0007] Data loading processing is performed on the first read information to obtain target read information; the target read information includes the N target read data information; and each target read data information includes at least one target loaded data information.

[0008] A second aspect of an embodiment of the present invention discloses a data processing device for high-frequency reading and writing, the device comprising:

[0009] An acquisition module is configured to acquire pending read information; the pending read information includes M pending read data information; the pending read data information includes data priority, read identification information, and read resource consumption information;

[0010] a first processing module, configured to classify and process the read information to be processed to obtain first read information; the first read information includes N first read data information; each first read data information includes at least one first data information to be processed; each first data information to be processed corresponds one-to-one to one of the read data information to be processed;

[0011] The second processing module is configured to perform data loading processing on the first read information to obtain target read information; the target read information includes the N target read data information; and each target read data information includes at least one target loaded data information.

[0012] A third aspect of the present invention discloses another data processing device for high-frequency reading and writing, the device comprising:

[0013] a memory storing executable program code;

[0014] a processor coupled to a memory;

[0015] The processor calls the executable program code stored in the memory to execute part or all of the steps in the data processing method for high-frequency reading and writing disclosed in the first aspect of the embodiment of the present invention.

[0016] The fourth aspect of the present invention discloses a computer-readable storage medium, which stores computer instructions. When the computer instructions are called, they are used to execute some or all of the steps in the data processing method for high-frequency reading and writing disclosed in the first aspect of an embodiment of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 This is a schematic diagram of a scenario of a data processing system for high-frequency reading and writing provided by an embodiment of the present invention;

[0019] Figure 2 This is a flow chart of a data processing method for high-frequency reading and writing disclosed in an embodiment of the present invention;

[0020] Figure 3 1 is a schematic structural diagram of a data processing device for high-frequency reading and writing disclosed in an embodiment of the present invention;

[0021] Figure 4It is a structural diagram of another data processing device for high-frequency reading and writing disclosed in an embodiment of the present invention. DETAILED DESCRIPTION

[0022] In order to enable those skilled in the art to better understand the solutions of the present invention, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings of the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts shall fall within the scope of protection of the present invention.

[0023] The terms "first," "second," and so on, in the description and claims of the present invention and the accompanying drawings are used to distinguish between different objects, not to describe a specific order. Furthermore, the terms "including," "having," and any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, apparatus, product, or device comprising a series of steps or elements is not limited to the listed steps or elements but may optionally include steps or elements not listed, or may optionally include other steps or elements inherent to the process, method, product, or device.

[0024] References herein to "embodiments" mean that a particular feature, structure, or characteristic described in connection with the embodiments may be included in at least one embodiment of the present invention. The appearance of this phrase in various places in the specification does not necessarily refer to the same embodiment, nor does it constitute a separate or alternative embodiment that is mutually exclusive of other embodiments. It is understood, both explicitly and implicitly, by those skilled in the art that the embodiments described herein may be combined with other embodiments.

[0025] In this application, the word "exemplary" is used to mean "serving as an example, illustration, or illustration." Any embodiment described in this application as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments. The following description is given to enable any person skilled in the art to implement and use the present application. In the following description, details are listed for the purpose of explanation. It should be understood that one of ordinary skill in the art can recognize that the present application can be implemented without using these specific details. In other instances, well-known structures and processes are not elaborated in detail to avoid obscuring the description of the present application with unnecessary details. Therefore, the present application is not intended to be limited to the embodiments shown, but is consistent with the widest scope consistent with the principles and features disclosed in this application.

[0026] It should be noted that since the method of the embodiment of the present application is executed in a computer device, the processing objects of each computer device exist in the form of data or information. For example, time is actually time information. It can be understood that if size, quantity, position, etc. are mentioned in subsequent embodiments, the corresponding data exist for the computer device to process. The details will not be repeated here.

[0027] It should be noted that the artificial intelligence related technologies that may be involved in this application are briefly described. Artificial Intelligence (AI) is the theory, method, technology and application system that uses digital computers or machines controlled by digital computers to simulate, extend and expand human intelligence, perceive the environment, acquire knowledge and use knowledge to obtain the best results. In other words, artificial intelligence is a comprehensive technology in computer science that attempts to understand the essence of intelligence and produce a new type of intelligent machine that can respond in a similar way to human intelligence. Artificial intelligence is to study the design principles and implementation methods of various intelligent machines, so that machines have the functions of perception, reasoning and decision-making.

[0028] Artificial intelligence (AI) technology is a comprehensive discipline encompassing a wide range of fields, encompassing both hardware and software technologies. Foundational AI technologies generally include sensors, specialized AI chips, cloud computing, distributed storage, big data processing, operating / interaction systems, and mechatronics. AI software technologies primarily encompass computer vision, speech processing, natural language processing, and machine learning / deep learning.

[0029] Computer vision (CV) is the science of making machines "see." Specifically, it refers to machine vision, where cameras and computers replace the human eye in identifying and measuring objects, performing further image processing to create images more suitable for human observation or transmission to instruments. As a scientific discipline, computer vision studies related theories and technologies, attempting to build artificial intelligence systems capable of extracting information from images or multidimensional data. Computer vision technologies typically include image processing, image recognition, image semantic understanding, image retrieval, optical character recognition (OCR), video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, and common biometric recognition technologies such as facial recognition and fingerprint recognition.

[0030] Unimodal information is data consisting of only one type, such as text, images, audio, video, or electromagnetic signals. Multimodal information is data that includes at least two types of unimodal information. Furthermore, multimodal information is suitable for complex tasks that require integrating multiple information sources, such as sentiment analysis, robot interaction, and autonomous driving. By integrating information from multiple modalities, higher performance and accuracy can often be achieved on the task.

[0031] A large model refers to an artificial neural network model with a very large number of parameters. In the field of artificial intelligence, a large model generally refers to a model with hundreds of millions to trillions of parameters. Models usually need to be trained on large-scale data sets and require a large amount of computing resources to be optimized and adjusted. Large models are generally used to solve complex tasks such as natural language processing, computer vision, and speech recognition. Generative AI is an AI that can create new content and ideas, including conversations, stories, images, videos, and music. In the embodiment of the present application, the large model can be ChatGPT, BERT, XLNet, Zhipu model, Claude, Moonshot AI model, ChatGLM model, Qianyi Tongwen model, MiniMax model, Spark model, Llama model, 360GPT model, Qwen model, Baichuan model, Skylark model, vivoLM model, Wenxin Yiyan and other large-scale language models, which are not limited in the embodiment of the present application.

[0032] The embodiments of the present application provide a data processing method, apparatus, computer device, and computer-readable storage medium for high-frequency reading and writing, which are described in detail below.

[0033] See also Figure 1 , Figure 1 This is a schematic diagram of a scenario of a data processing system for high-frequency reading and writing provided in an embodiment of the present application. The data processing system for high-frequency reading and writing may include a computer device 100, in which a data processing device for high-frequency reading and writing is integrated, such as Figure 1 Computer equipment in.

[0034] In the embodiment of the present application, the computer device 100 is mainly used to obtain pending read information; the pending read information includes M pending read data information; the pending read data information includes data priority, read identification information and read resource consumption information;

[0035] Classifying and processing the read information to be processed to obtain first read information; the first read information includes N first read data information; each first read data information includes at least one first data information to be processed; each first data information to be processed corresponds one to one to one read data information to be processed;

[0036] Data loading processing is performed on the first read information to obtain target read information; the target read information includes N target read data information; each target read data information includes at least one target loaded data information.

[0037] It can improve the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0038] In the embodiments of the present application, the computer device 100 may be an independent server, or a server network or server cluster composed of servers. For example, the computer device 100 described in the embodiments of the present application includes, but is not limited to, a computer, a network host, a single network server, a set of multiple network servers, or a cloud server composed of multiple servers. A cloud server is composed of a large number of computers or network servers based on cloud computing.

[0039] It is understood that the computer device 100 used in the embodiments of the present application can be a device that includes both receiving and transmitting hardware, that is, a device that has receiving and transmitting hardware capable of performing two-way communication over a two-way communication link. Such a device may include: a cellular or other communication device that has a single-line display, a multi-line display, or a cellular or other communication device without a multi-line display. The specific computer device 100 can be a desktop terminal or a mobile terminal. The computer device 100 can also be a mobile phone, a tablet computer, a laptop computer, etc.

[0040] Those skilled in the art will understand that Figure 1 The application environment shown in the figure is only one application scenario of the present application solution and does not constitute a limitation on the application scenario of the present application solution. Other application environments may also include Figure 1 More or fewer computer devices as shown in Figure 1 Only one computer device is shown. It can be understood that the data processing system for high-frequency reading and writing can also include one or more other services, which are not specifically limited here.

[0041] In addition, if Figure 1 As shown, the data processing system for high-frequency reading and writing may further include a memory 200 for storing data, such as image data, position information, and the like.

[0042] It should be noted that Figure 1The scenario diagram of the data processing system for high-frequency reading and writing shown is only an example. The data processing system and scenario for high-frequency reading and writing described in the embodiment of the present application are intended to more clearly illustrate the technical solution of the embodiment of the present application, and do not constitute a limitation on the technical solution provided by the embodiment of the present application. Ordinary technicians in this field can know that with the evolution of the data processing system for high-frequency reading and writing and the emergence of new business scenarios, the technical solution provided by the embodiment of the present application is also applicable to similar technical problems.

[0043] The present invention discloses a data processing method and device for high-frequency reading and writing, which are beneficial for improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing. Detailed descriptions are given below.

[0044] Example 1

[0045] See also Figure 2 , Figure 2 This is a flow chart of a data processing method for high-frequency reading and writing disclosed in an embodiment of the present invention. Figure 2 The data processing method for high-frequency reading and writing described is applied to a management system, such as a local server or cloud server for management, etc., which is not limited in the embodiment of the present invention. Figure 2 As shown, the data processing method for high-frequency reading and writing may include the following operations:

[0046] 101. Obtain pending read information.

[0047] In an embodiment of the present invention, the to-be-processed read information includes M pieces of to-be-processed read data information; the to-be-processed read data information includes data priority, read identification information, and read resource consumption information.

[0048] 102. Classify the read information to be processed to obtain first read information.

[0049] In the embodiment of the present invention, the first read information includes N first read data information; each first read data information includes at least one first data information to be processed; and each first data information to be processed corresponds one-to-one to one read data information to be processed.

[0050] 103. Perform data loading processing on the first read information to obtain target read information.

[0051] In the embodiment of the present invention, the target read information includes N target read data information; each target read data information includes at least one target load data information.

[0052] It should be noted that the data processing method for high-frequency reading and writing in this application can significantly improve the speed and system responsiveness of high-frequency reading and writing operations, and ensure the integrity and reliability of data in high-frequency reading and writing operations through data compression, priority management and fault recovery mechanisms. This method is suitable for fields with high demands for high-frequency reading and writing, such as finance, real-time analysis, and the Internet of Things. That is, it can be deployed in scenarios such as real-time data processing systems or Internet of Things management platforms to improve their data reading and writing efficiency, and the embodiments of the present invention do not limit this.

[0053] It should be noted that after obtaining the read information to be processed, the present application also has a fault recovery mechanism. That is, in high-frequency read and write operations, the risk of data loss or damage increases. The present application introduces data redundancy and logging mechanisms. Once a fault occurs, the system can automatically recover to the state before the fault to ensure data integrity and consistency. The logging module will record each write operation in detail to ensure that in the event of an unexpected power outage or system crash, data can be rolled back or rebuilt to ensure the integrity and reliability of data in high-frequency read and write operations. The embodiments of the present invention are not limited to this.

[0054] It should be noted that the system based on the method of the present application is configured with a high-performance multi-core processor, multi-level cache and high-speed storage media to ensure that the hardware foundation can support high-frequency read and write operations. The system can be deployed in scenarios such as real-time data processing systems or Internet of Things management platforms to improve its data reading and writing efficiency, which is not limited in the embodiments of the present invention.

[0055] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiment of the present invention is conducive to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0056] In an optional embodiment, the classification processing of the read data information to be processed to obtain the first read information includes:

[0057] Sort the read data information to be processed from high to low according to the data priority to obtain a sequence of read data to be processed;

[0058] Obtain hardware resource information; hardware resource information includes several available resource information;

[0059] Using the read resource consumption information in the read data information to be processed to filter and sort the hardware resource information, a hardware resource sequence is obtained;

[0060] First read information is obtained based on the hardware resource sequence and the sequence of read data to be processed.

[0061] It should be noted that the above-mentioned data priority is to set the read and write priority based on the application scenario and the importance of the data. For example, the read and write operations of critical data in financial transactions are set to high priority to ensure that they can be processed first. This is not limited in the embodiments of the present invention. Furthermore, when the first read information is obtained based on the hardware resource sequence and the sequence of read data to be processed, if the total amount of processor resources is insufficient, the system will delay the processing of low-priority data read and write requests when resources are scarce to ensure the stability of the entire system. This is not limited in the embodiments of the present invention.

[0062] It should be noted that the above-mentioned available resource information represents the total amount of resources that the processor can use to process data, such as the total amount of at least one of physical memory (RAM), virtual memory, processing power (such as the number of CPU cores, frequency), and other hardware resources (such as GPU, storage space), etc., and is not limited in the embodiments of the present invention.

[0063] It should be noted that the above-mentioned use of the read resource consumption information in the read data information to be processed to screen and sort the hardware resource information, and subsequently selecting an available resource information as the target from the hardware resource sequence in sequence. The available resource information is to eliminate the available resource information whose total resource amount of the processor is less than the resource consumption amount corresponding to the read resource consumption information from the hardware resource information, and then sort the available resource information in order from small to large according to the total resource amount of the processor, so as to ensure that the processor corresponding to the minimum total resource amount can be used first, thereby improving the utilization efficiency of the hardware resources. The embodiment of the present invention does not limit this.

[0064] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiment of the present invention is conducive to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0065] In another optional embodiment, obtaining first read information based on the hardware resource sequence and the sequence of read data to be processed includes:

[0066] Sequentially selecting one available resource information from the hardware resource sequence as target available resource information;

[0067] Based on a relationship between an available resource amount corresponding to the target available resource information and a read resource consumption amount corresponding to the read resource consumption information, selecting at least one to-be-processed read data information from the to-be-processed read data sequence as first to-be-processed data information corresponding to the first read data information;

[0068] Eliminate the read data information to be processed corresponding to the first data information to be processed from the read data sequence to be processed;

[0069] Determine whether there is any read data information to be processed in the read data sequence to be processed, and obtain a first determination result;

[0070] When the first judgment result is yes, determining whether the available resource information corresponding to the target available resource information is the last available resource information in the hardware resource sequence, and obtaining a second judgment result;

[0071] When the second judgment result is no, triggering execution to sequentially select one available resource information from the hardware resource sequence as target available resource information;

[0072] When the second judgment result is yes, triggering execution of data loading processing on the first read information to obtain target read information;

[0073] When the first judgment result is no, a data loading process is triggered to be performed on the first read information to obtain target read information.

[0074] It should be noted that the above-mentioned selection of at least one to-be-processed read data information as the first to-be-processed data information corresponding to the first read data information from the to-be-processed read data sequence based on the size relationship between the available resource amount corresponding to the target available resource information and the read resource consumption amount corresponding to the read resource consumption information is to determine the number of to-be-processed read data information processed by each hardware device based on the number of read resource consumption information that can be processed by the available resource amount corresponding to each hardware device, which is not limited in the embodiment of the present invention. For example, when the available resource amount is 2 resource units and the read resource consumption amount is 1 resource unit, it represents that the available resource amount corresponding to the target available resource information can process 2 to-be-processed read data information, then the first to-be-processed data information corresponding to the first read data information has 2 to-be-processed read data information, which is not limited in the embodiment of the present invention. Furthermore, the number of the above-mentioned available resource amounts is rounded down. For example, when the available resource amount is 3.5 resource units, it is only regarded as 3 resource units, which is not limited in the embodiment of the present invention.

[0075] It should be noted that the above-mentioned removal of the pending read data information corresponding to the first pending data information from the pending read data sequence is to exclude the pending read data information that has been assigned to the hardware device, thereby ensuring that the pending read data information will not be repeatedly loaded and written, thereby improving the efficiency and accuracy of data reading, and the embodiments of the present invention are not limited to this.

[0076] It should be noted that the above-mentioned judgment of whether there is pending read data information in the pending read data sequence is to analyze and determine whether there is still pending read data information that needs to be read and written. Furthermore, the judgment of whether the available resource information corresponding to the target available resource information is the last available resource information in the hardware resource sequence is based on the existence of pending read data information that has not yet been allocated hardware resources. Further analysis is made as to whether there are available hardware resources to ensure that the pending read data information can be effectively read and written, thereby improving the efficiency and reliability of high-frequency data reading and writing. The embodiments of the present invention do not limit this.

[0077] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiment of the present invention is conducive to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0078] In yet another optional embodiment, performing data loading processing on the first read information to obtain target read information includes:

[0079] For any first read data information in the first read information, and for any first to-be-processed data information in the first read data information, loading stored data information matching the first to-be-processed data information from the data cache area to obtain first loaded data information corresponding to the first to-be-processed data information; the data cache area includes a first cache area, a second cache area, and a third cache area; data reading speeds of the first cache area, the second cache area, and the third cache area decrease in sequence; the stored data information includes a plurality of first stored data information stored in the first cache area, a plurality of second stored data information stored in the second cache area, and a plurality of third stored data information stored in the third cache area;

[0080] The first loaded data information is parsed and processed to obtain target loaded data information corresponding to the first data information to be processed.

[0081] It should be noted that the data cache area of ​​the present application is constructed using a multi-level cache mechanism. Furthermore, the above-mentioned first cache area, second cache area and third cache area correspond to high-speed cache (such as SRAM), medium-speed cache (such as DRAM) and persistent cache (such as SSD), respectively. Furthermore, when loading the storage data information matching the first data information to be processed from the data cache area, data loading and reading are performed preferentially from the cache area with a fast data reading speed, that is, high-frequency read and write requests are processed in the high-speed cache first, and miss requests will be searched in the medium-speed cache and persistent cache in turn, thereby improving the efficiency of data loading and reading. The embodiments of the present invention do not limit this.

[0082] In this optional embodiment, as an optional implementation manner, the first stored data information is updated based on the following method:

[0083] For any first stored data information, obtaining the usage frequency and the most recent usage time corresponding to the first stored data information;

[0084] Performing table lookup and quantization processing on the usage frequency and the most recent usage time corresponding to the first stored data information using a frequency quantization table and a time quantization table respectively to obtain a first quantization value and a second quantization value;

[0085] Calculating the first quantized value and the second quantized value using a quantization calculation model to obtain a target quantized value;

[0086] Among them, the quantitative calculation model is:

[0087] Target quantization value = first quantization coefficient * first quantization value + first quantization coefficient * second quantization value;

[0088] Determine whether the target quantity quantization value is greater than a first quantization threshold value, and obtain a first quantization determination result;

[0089] When the first quantization judgment result is no, determining whether the target quantity quantization value is greater than a second quantization threshold value, and obtaining a second quantization judgment result;

[0090] When the second quantification judgment result is yes, determining the first stored data information as a new second stored data information;

[0091] When the second quantization judgment result is no, determining the first stored data information as a new third stored data information;

[0092] When the first quantization judgment result is yes, the first stored data information is determined to be a new first stored data information.

[0093] Furthermore, when the first stored data information is updated, if the updated first stored data information is not the first stored data information, the first stored data information is deleted from the first cache area, which is not limited in the embodiment of the present invention.

[0094] It should be noted that the updating method of the second stored data information and the third stored data information is consistent with that of the first stored data information, and is not limited in the embodiment of the present invention.

[0095] It should be noted that the first quantization threshold may be set by the user, a default value given by the system, or an average of historical first quantization thresholds, and this is not limited in this embodiment of the present invention. Furthermore, the first quantization threshold may be greater than the second quantization threshold and greater than 0, and this is not limited in this embodiment of the present invention.

[0096] It should be noted that the second quantization threshold can be set by the user, a default value given by the system, or an average of historical second quantization thresholds, which is not limited in the present embodiment. Furthermore, the second quantization threshold is greater than 0, which is not limited in the present embodiment.

[0097] It should be noted that the first quantization coefficient and the second quantization coefficient are values ​​between [0, 1], which are not limited in the embodiment of the present invention.

[0098] It should be noted that the usage frequency and the most recent usage time represent the frequency and the most recent time the stored data is read and written within an update time unit, respectively, and are not limited in this embodiment of the present invention. Furthermore, the update time unit can be 1 hour, 1 day, 1 week, etc., and are not limited in this embodiment of the present invention.

[0099] It should be noted that the above frequency quantization table and time quantization table can be respectively:

[0100] Frequency of use Quantized value (0,10] 1 (10,20] 2 (20,30] 3 >30 4

[0101] Last used time (update time unit) Quantized value (0,0.1] 5 (0.1,0.3] 4 (0.3,0.5] 3 >0.5 1

[0102] It should be noted that the above-mentioned update of the stored data information is to reduce the decrease in cache hit rate. The dynamic cache replacement strategy adopted dynamically adjusts the cache content according to the data access frequency and the most recent usage time, which is not limited in the embodiment of the present invention.

[0103] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiment of the present invention is conducive to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0104] In yet another optional embodiment, loading stored data information matching the first data information to be processed from a data cache area to obtain first loaded data information corresponding to the first data information to be processed includes:

[0105] Using a matching calculation model, the first stored data information and the first data information to be processed are calculated to obtain first matching value information; the first matching value information includes a plurality of first matching values;

[0106] Among them, the matching calculation model is:

[0107]

[0108] Wherein, DYPPZ represents the first matching value; A represents the first stored data information; B represents the first data information to be processed; aa and bb represent the first matching coefficient and the second matching coefficient respectively;

[0109] Determine whether there is a first matching value greater than or equal to a matching threshold in the first matching value information, and obtain a first matching determination result;

[0110] When the first matching judgment result is yes, determining the first stored data information corresponding to the first matching value greater than or equal to the matching threshold as the first loaded data information corresponding to the first data information to be processed;

[0111] When the first matching judgment result is no, second matching value information is determined based on the matching calculation model and the second stored data information; the second matching value information includes a plurality of second matching values;

[0112] Determine whether there is a second matching value greater than or equal to the matching threshold in the second matching value information, and obtain a second matching judgment result;

[0113] When the second matching judgment result is yes, determining the second stored data information corresponding to the second matching value greater than or equal to the matching threshold as the first loaded data information corresponding to the first data information to be processed;

[0114] When the second matching judgment result is , the first loaded data information corresponding to the first to-be-processed data information is determined based on the matching calculation model and the third stored data information.

[0115] It should be noted that the first stored data information and the first to-be-processed data information may be represented in a vector form, which is not limited in the embodiment of the present invention.

[0116] It should be noted that the first matching coefficient and the second matching coefficient are values ​​of [0, 1], which are not limited in the embodiment of the present invention.

[0117] It should be noted that the above matching threshold can be set by the user, or can be a default value given by the system, or can be determined by averaging historical matching thresholds, which is not limited in the present embodiment. Further, it is a positive number greater than 1, which is not limited in the present embodiment.

[0118] It should be noted that the above-mentioned first matching value represents the correlation between the first stored data information and the first data information to be processed. When the first matching value is greater than or equal to the matching threshold, it represents that the first stored data information is the data information that needs to be loaded by the first data information to be processed. The embodiment of the present invention does not limit this.

[0119] It should be noted that the above-mentioned method of determining the second matching value information based on the matching calculation model and the second stored data information, and determining the first loaded data information corresponding to the first data information to be processed based on the matching calculation model and the third stored data information, the target loading data determination method of these two cache areas is consistent with the method of calculating and processing the first stored data information using the matching calculation model, and the embodiment of the present invention does not limit this.

[0120] It should be noted that the above-mentioned parsing and processing of the first loaded data information is performed during the process of rapid data reading and writing, reducing the time and storage space consumption of data transmission in high-frequency reading and writing operations, so that no obvious performance overhead is introduced in the data reading and writing process, and the embodiments of the present invention do not limit this.

[0121] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiment of the present invention is conducive to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0122] In an optional embodiment, the above-mentioned parsing and processing of the first loaded data information to obtain the target loaded data information corresponding to the first data information to be processed includes:

[0123] Segmenting the first loaded data information to obtain a plurality of sequentially distributed segmented data information; the segmented data information includes frame header information and character information;

[0124] For any segmented data information, parse the frame header information of the segmented data information to obtain a first parsed length value and a second parsed length value;

[0125] Selecting characters whose number matches the first parsed length value from the character information corresponding to the segmented data information from left to right as the first parsed character information corresponding to the segmented data information;

[0126] Performing conversion processing on the first parsed character information to obtain first target character information corresponding to the segmented data information;

[0127] Selecting characters whose number matches the second parsed length value from the character information corresponding to the segmented data information from left to right as the second parsed character information corresponding to the segmented data information;

[0128] Performing conversion processing on the second parsed character information to obtain second target character information corresponding to the segmented data information;

[0129] Performing splicing processing on the first target character information and the second target character information to obtain target parsed data information corresponding to the segmented data information;

[0130] Based on the position sequence relationship of the segmented data information, the target parsed data information corresponding to all the segmented data information is spliced ​​to obtain the target loaded data information corresponding to the first data information to be processed.

[0131] It should be noted that the above segmentation processing of the first loaded data information is performed according to the separator (such as "-", etc.) in the frame header information, that is, the data between two separators is determined as one segmented data information, which is not limited in the embodiment of the present invention.

[0132] It should be noted that the above character information is data represented in decimal, which is not limited by the embodiment of the present invention. Further, selecting characters of the same number as the second parsed length value from left to right from the character information corresponding to the segmented data information as the second parsed character information corresponding to the segmented data information is to select valid character information in the segmented data information, thereby ensuring the effectiveness and reliability of data loading and reading, which is not limited by the embodiment of the present invention. Further, the above character information of the same number as the second parsed length value from left to right from the character information corresponding to the segmented data information is to load the repeated part of the data twice, mainly because the data format in this application is in the form of XY, where Y is part of the content of X, which is not limited by the embodiment of the present invention.

[0133] It should be noted that the conversion processing of the first parsed character information and the conversion processing of the second parsed character information are to convert decimal data into character strings, which is not limited in the embodiment of the present invention.

[0134] It should be noted that the above-mentioned splicing process of the first target character information and the second target character information is to splice the second target character information after the first target character information, which is not limited in the embodiment of the present invention.

[0135] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiment of the present invention is conducive to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0136] In another optional embodiment, parsing the frame header information of the segmented data information to obtain the first parsed length value and the second parsed length value includes:

[0137] Performing binary conversion on the frame header information of the segmented data information to obtain segmentation conversion information;

[0138] The segmented conversion information is segmented to obtain first segmented conversion information, second segmented conversion information, and third segmented conversion information; the second segmented conversion information represents the last two bits of data in the segmented conversion information; the third segmented conversion information represents the third-to-last bit and the fourth-to-last bit of data in the segmented conversion information;

[0139] Performing decimal conversion processing on the first segmentation conversion information to obtain a first parsed length value;

[0140] Performing decimal conversion processing on the second segmentation conversion information and the third segmentation conversion information respectively to obtain a first standby length value and a second standby length value;

[0141] The first standby length value and the second standby length value are summed to obtain a second parsed length value.

[0142] It should be noted that the binary conversion of the frame header information of the segmented data information is to convert decimal data into binary data, so as to convert short decimal data into long-byte binary data information, which is not limited in the embodiment of the present invention.

[0143] It should be noted that the above-mentioned segmentation processing of the segmentation conversion information is to orderly segment the binary information storing the position information, so as to obtain the position and quantity of the decimal data corresponding to the first target character information and the second target character information, so as to facilitate subsequent decryption and analysis processing, thereby improving data reading efficiency while ensuring data security, and the embodiments of the present invention do not limit this.

[0144] It should be noted that the above-mentioned decimal conversion processing of the first segmentation conversion information and the decimal conversion processing of the second segmentation conversion information and the third segmentation conversion information are respectively performed to realize the decimal conversion of natural language understanding, thereby realizing the position positioning according to the decimal data and effectively improving the data loading and reading and writing efficiency. The embodiments of the present invention do not limit this.

[0145] It can be seen that implementing the data processing method for high-frequency reading and writing described in the embodiment of the present invention is conducive to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0146] Example 2

[0147] See also Figure 3 , Figure 3 This is a schematic diagram of the structure of a data processing device for high-frequency reading and writing disclosed in an embodiment of the present invention. Figure 3 The described device can be applied to a management system, such as a local server or a cloud server for management, etc., and the embodiment of the present invention does not limit this. Figure 3 As shown, the device may include:

[0148] The acquisition module 201 is used to acquire the pending read information; the pending read information includes M pending read data information; the pending read data information includes data priority, read identification information and read resource consumption information;

[0149] The first processing module 202 is configured to classify the read information to be processed to obtain first read information; the first read information includes N first read data information; each first read data information includes at least one first data information to be processed; each first data information to be processed corresponds to one read data information to be processed;

[0150] The second processing module 203 is configured to perform data loading processing on the first read information to obtain target read information; the target read information includes N target read data information; each target read data information includes at least one target loaded data information.

[0151] It can be seen that implementation Figure 3 The described data processing device for high-frequency reading and writing is beneficial to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0152] In another optional embodiment, Figure 3 As shown, the first processing module 202 classifies the read data information to be processed to obtain first read information, including:

[0153] Sort the read data information to be processed from high to low according to the data priority to obtain a sequence of read data to be processed;

[0154] Obtain hardware resource information; hardware resource information includes several available resource information;

[0155] Using the read resource consumption information in the read data information to be processed to filter and sort the hardware resource information, a hardware resource sequence is obtained;

[0156] First read information is obtained based on the hardware resource sequence and the sequence of read data to be processed.

[0157] It can be seen that implementation Figure 3 The described data processing device for high-frequency reading and writing is beneficial to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0158] In another optional embodiment, Figure 3 As shown, the first processing module 202 obtains first read information based on the hardware resource sequence and the sequence of read data to be processed, including:

[0159] Sequentially selecting one available resource information from the hardware resource sequence as target available resource information;

[0160] Based on a relationship between an available resource amount corresponding to the target available resource information and a read resource consumption amount corresponding to the read resource consumption information, selecting at least one to-be-processed read data information from the to-be-processed read data sequence as first to-be-processed data information corresponding to the first read data information;

[0161] Eliminate the read data information to be processed corresponding to the first data information to be processed from the read data sequence to be processed;

[0162] Determine whether there is any read data information to be processed in the read data sequence to be processed, and obtain a first determination result;

[0163] When the first judgment result is yes, determining whether the available resource information corresponding to the target available resource information is the last available resource information in the hardware resource sequence, and obtaining a second judgment result;

[0164] When the second judgment result is no, triggering execution to sequentially select one available resource information from the hardware resource sequence as target available resource information;

[0165] When the second judgment result is yes, triggering execution of data loading processing on the first read information to obtain target read information;

[0166] When the first judgment result is no, a data loading process is triggered to be performed on the first read information to obtain target read information.

[0167] It can be seen that implementation Figure 3 The described data processing device for high-frequency reading and writing is beneficial to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0168] In another optional embodiment, Figure 3 As shown, the second processing module 203 performs data loading processing on the first read information to obtain target read information, including:

[0169] For any first read data information in the first read information, and for any first to-be-processed data information in the first read data information, loading stored data information matching the first to-be-processed data information from the data cache area to obtain first loaded data information corresponding to the first to-be-processed data information; the data cache area includes a first cache area, a second cache area, and a third cache area; data reading speeds of the first cache area, the second cache area, and the third cache area decrease in sequence; the stored data information includes a plurality of first stored data information stored in the first cache area, a plurality of second stored data information stored in the second cache area, and a plurality of third stored data information stored in the third cache area;

[0170] The first loaded data information is parsed and processed to obtain target loaded data information corresponding to the first data information to be processed.

[0171] It can be seen that implementation Figure 3 The described data processing device for high-frequency reading and writing is beneficial to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0172] In another optional embodiment, Figure 3 As shown, the second processing module 203 loads the stored data information matching the first data information to be processed from the data cache area to obtain the first loaded data information corresponding to the first data information to be processed, including:

[0173] Using a matching calculation model, the first stored data information and the first data information to be processed are calculated to obtain first matching value information; the first matching value information includes a plurality of first matching values;

[0174] Among them, the matching calculation model is:

[0175]

[0176] Wherein, DYPPZ represents the first matching value; A represents the first stored data information; B represents the first data information to be processed; aa and bb represent the first matching coefficient and the second matching coefficient respectively;

[0177] Determine whether there is a first matching value greater than or equal to a matching threshold in the first matching value information, and obtain a first matching determination result;

[0178] When the first matching judgment result is yes, determining the first stored data information corresponding to the first matching value greater than or equal to the matching threshold as the first loaded data information corresponding to the first data information to be processed;

[0179] When the first matching judgment result is no, second matching value information is determined based on the matching calculation model and the second stored data information; the second matching value information includes a plurality of second matching values;

[0180] Determine whether there is a second matching value greater than or equal to the matching threshold in the second matching value information, and obtain a second matching judgment result;

[0181] When the second matching judgment result is yes, determining the second stored data information corresponding to the second matching value greater than or equal to the matching threshold as the first loaded data information corresponding to the first data information to be processed;

[0182] When the second matching judgment result is , the first loaded data information corresponding to the first to-be-processed data information is determined based on the matching calculation model and the third stored data information.

[0183] It can be seen that implementation Figure 3 The described data processing device for high-frequency reading and writing is beneficial to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0184] In another optional embodiment, Figure 3 As shown, the second processing module 203 parses the first loaded data information to obtain target loaded data information corresponding to the first data information to be processed, including:

[0185] Segmenting the first loaded data information to obtain a plurality of sequentially distributed segmented data information; the segmented data information includes frame header information and character information;

[0186] For any segmented data information, parse the frame header information of the segmented data information to obtain a first parsed length value and a second parsed length value;

[0187] Selecting characters whose number matches the first parsed length value from the character information corresponding to the segmented data information from left to right as the first parsed character information corresponding to the segmented data information;

[0188] Performing conversion processing on the first parsed character information to obtain first target character information corresponding to the segmented data information;

[0189] Selecting characters whose number matches the second parsed length value from the character information corresponding to the segmented data information from left to right as the second parsed character information corresponding to the segmented data information;

[0190] Performing conversion processing on the second parsed character information to obtain second target character information corresponding to the segmented data information;

[0191] Performing splicing processing on the first target character information and the second target character information to obtain target parsed data information corresponding to the segmented data information;

[0192] Based on the position sequence relationship of the segmented data information, the target parsed data information corresponding to all the segmented data information is spliced ​​to obtain the target loaded data information corresponding to the first data information to be processed.

[0193] It can be seen that implementation Figure 3 The described data processing device for high-frequency reading and writing is beneficial to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0194] In another optional embodiment, Figure 3 As shown, the second processing module 203 parses the frame header information of the segmented data information to obtain a first parsed length value and a second parsed length value, including:

[0195] Performing binary conversion on the frame header information of the segmented data information to obtain segmentation conversion information;

[0196] The segmented conversion information is segmented to obtain first segmented conversion information, second segmented conversion information, and third segmented conversion information; the second segmented conversion information represents the last two bits of data in the segmented conversion information; the third segmented conversion information represents the third-to-last bit and the fourth-to-last bit of data in the segmented conversion information;

[0197] Performing decimal conversion processing on the first segmentation conversion information to obtain a first parsed length value;

[0198] Performing decimal conversion processing on the second segmentation conversion information and the third segmentation conversion information respectively to obtain a first standby length value and a second standby length value;

[0199] The first standby length value and the second standby length value are summed to obtain a second parsed length value.

[0200] It can be seen that implementation Figure 3 The described data processing device for high-frequency reading and writing is beneficial to improving the speed and reliability of high-frequency data reading and writing, thereby effectively meeting the needs of high-frequency data reading and writing.

[0201] Example 3

[0202] See also Figure 4 , Figure 4 This is a schematic diagram of the structure of another data processing device for high-frequency reading and writing disclosed in an embodiment of the present invention. Figure 4 The described device can be applied to a management system, such as a local server or a cloud server for management, etc., and the embodiment of the present invention does not limit this. Figure 4 As shown, the device may include:

[0203] A memory 301 storing executable program code;

[0204] a processor 302 coupled to the memory 301;

[0205] The processor 302 calls the executable program code stored in the memory 301 to execute the steps of the data processing method for high-frequency reading and writing described in the first embodiment.

[0206] Example 4

[0207] An embodiment of the present invention discloses a computer-readable storage medium storing a computer program for electronic data exchange, wherein the computer program enables a computer to execute the steps of the data processing method for high-frequency reading and writing described in the first embodiment.

[0208] Example 5

[0209] An embodiment of the present invention discloses a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to enable a computer to execute the steps of the data processing method for high-frequency reading and writing described in embodiment 1.

[0210] The device embodiments described above are merely illustrative. Modules described as separate components may or may not be physically separate, and components shown as modules may or may not be physical modules, i.e., they may be located in one place or distributed across multiple network modules. Some or all of the modules may be selected based on actual needs to achieve the objectives of the present embodiment. Persons of ordinary skill in the art will be able to understand and implement the present invention without inventive effort.

[0211] Through the detailed description of the above embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus the necessary general hardware platform, or of course, by means of hardware. Based on this understanding, the above technical solution, in essence, or the portion that contributes to the prior art, can be embodied in the form of a software product, which can be stored in a computer-readable storage medium, including a read-only memory (ROM), a random access memory (RAM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), a one-time programmable read-only memory (OTPROM), an electronically erasable programmable read-only memory (EEPROM), a compact disc read-only memory (CD-ROM) or other optical disc storage, magnetic disk storage, magnetic tape storage, or any other computer-readable medium capable of carrying or storing data.

[0212] Finally, it should be noted that the data processing method and device for high-frequency reading and writing disclosed in the embodiments of the present invention are only preferred embodiments of the present invention, and are only used to illustrate the technical solutions of the present invention, rather than to limit them. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments can still be modified, or some of the technical features therein can be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the various embodiments of the present invention.

Claims

1. A data processing method for high-frequency reading and writing, characterized in that: The method comprises: Obtaining pending read information; the pending read information includes M pending read data information; the pending read data information includes data priority, read identification information, and read resource consumption information; Classifying and processing the read information to be processed to obtain first read information; the first read information includes N first read data information; each first read data information includes at least one first data information to be processed; each first data information to be processed corresponds one-to-one to one read data information to be processed; Performing data loading processing on the first read information to obtain target read information; the target read information includes N target read data information; each target read data information includes at least one target loaded data information; The step of performing data loading processing on the first read information to obtain target read information includes: For any of the first read data information in the first read information and for any of the first to-be-processed data information in the first read data information, loading stored data information matching the first to-be-processed data information from a data cache area to obtain first loaded data information corresponding to the first to-be-processed data information; parsing the first loaded data information to obtain target loaded data information corresponding to the first data information to be processed; The parsing of the first loaded data information to obtain target loaded data information corresponding to the first data information to be processed includes: Segmenting the first loaded data information to obtain a plurality of sequentially distributed segmented data information; the segmented data information includes frame header information and character information; For any of the segmented data information, parse the frame header information of the segmented data information to obtain a first parsed length value and a second parsed length value; Selecting characters whose number matches the first parsed length value from the character information corresponding to the segmented data information from left to right as the first parsed character information corresponding to the segmented data information; performing conversion processing on the first parsed character information to obtain first target character information corresponding to the segmented data information; Selecting characters whose number matches the second parsed length value from the character information corresponding to the segmented data information from left to right as the second parsed character information corresponding to the segmented data information; performing conversion processing on the second parsed character information to obtain second target character information corresponding to the segmented data information; performing splicing processing on the first target character information and the second target character information to obtain target parsed data information corresponding to the segmented data information; Based on the position sequence relationship of the segmented data information, target parsed data information corresponding to all the segmented data information is spliced ​​to obtain target loaded data information corresponding to the first data information to be processed.

2. The data processing method for high-frequency reading and writing according to claim 1, characterized in that: The classifying and processing the to-be-processed read data information to obtain first read information includes: Sort the data to be processed read data information from high to low according to the data priority to obtain a sequence of read data to be processed; Obtaining hardware resource information; the hardware resource information includes information on several available resources; Filtering and sorting the hardware resource information using the read resource consumption information in the read data information to be processed to obtain a hardware resource sequence; First read information is obtained based on the hardware resource sequence and the sequence of read data to be processed.

3. The data processing method for high-frequency reading and writing according to claim 2, characterized in that: The obtaining first read information based on the hardware resource sequence and the sequence of read data to be processed includes: sequentially selecting one of the available resource information from the hardware resource sequence as target available resource information; Based on a magnitude relationship between an available resource amount corresponding to the target available resource information and a read resource consumption amount corresponding to the read resource consumption information, selecting at least one of the to-be-processed read data information from the to-be-processed read data sequence as the first to-be-processed data information corresponding to the first read data information; Eliminate the to-be-processed read data information corresponding to the first to-be-processed data information from the to-be-processed read data sequence; Determining whether the read data to be processed exists in the read data sequence to be processed, and obtaining a first determination result; When the first judgment result is yes, determining whether the available resource information corresponding to the target available resource information is the last available resource information in the hardware resource sequence, to obtain a second judgment result; When the second judgment result is no, triggering the execution of sequentially selecting one of the available resource information from the hardware resource sequence as the target available resource information; When the second judgment result is yes, triggering execution of the data loading process on the first read information to obtain target read information; When the first judgment result is no, the data loading process for the first read information is triggered to obtain target read information.

4. The data processing method for high-frequency reading and writing according to claim 1, characterized in that: The data cache area includes a first cache area, a second cache area, and a third cache area; the data reading speeds of the first cache area, the second cache area, and the third cache area decrease in sequence; the stored data information includes a plurality of first stored data information stored in the first cache area, a plurality of second stored data information stored in the second cache area, and a plurality of third stored data information stored in the third cache area; The step of loading stored data information matching the first data information to be processed from the data cache area to obtain first loaded data information corresponding to the first data information to be processed includes: Using a matching calculation model, the first stored data information and the first data information to be processed are calculated to obtain first matching value information; the first matching value information includes a plurality of first matching values; Among them, the matching calculation model is: ； Where, characterizing the first matching value; Characterizing the first stored data information; Characterizing the first data to be processed; and Respectively characterize the first matching coefficient and the second matching coefficient; Determine whether there is a first matching value greater than or equal to a matching threshold in the first matching value information, and obtain a first matching determination result; When the first matching judgment result is yes, determining the first stored data information corresponding to the first matching value greater than or equal to the matching threshold as the first loaded data information corresponding to the first data information to be processed; When the first matching judgment result is no, determining second matching value information based on the matching calculation model and the second stored data information; the second matching value information includes a plurality of second matching values; Determine whether there is a second matching value greater than or equal to the matching threshold in the second matching value information, and obtain a second matching determination result; When the second matching judgment result is yes, determining the second stored data information corresponding to the second matching value greater than or equal to the matching threshold as the first loaded data information corresponding to the first data information to be processed; When the second matching judgment result is no, first loaded data information corresponding to the first to-be-processed data information is determined based on the matching calculation model and the third stored data information.

5. The data processing method for high-frequency reading and writing according to claim 1, characterized in that: The parsing of the frame header information of the segmented data information to obtain the first parsed length value and the second parsed length value includes: Performing binary conversion on the frame header information of the segmented data information to obtain segmentation conversion information; Segmenting the segmented conversion information to obtain first segmented conversion information, second segmented conversion information, and third segmented conversion information; the second segmented conversion information represents the last two bits of data in the segmented conversion information; the third segmented conversion information represents the third-to-last bit and the fourth-to-last bit of data in the segmented conversion information; Performing decimal conversion on the first segmentation and conversion information to obtain a first parsed length value; Performing decimal conversion processing on the second segmentation conversion information and the third segmentation conversion information respectively to obtain a first standby length value and a second standby length value; The first standby length value and the second standby length value are summed to obtain a second parsed length value.

6. A data processing device for high-frequency reading and writing, characterized in that: The device comprises: An acquisition module is configured to acquire pending read information; the pending read information includes M pending read data information; the pending read data information includes data priority, read identification information, and read resource consumption information; a first processing module, configured to classify and process the read information to be processed to obtain first read information; the first read information includes N first read data information; each first read data information includes at least one first data information to be processed; each first data information to be processed corresponds one-to-one to one of the read data information to be processed; a second processing module, configured to perform data loading processing on the first read information to obtain target read information; the target read information includes N target read data information; each target read data information includes at least one target loaded data information; The step of performing data loading processing on the first read information to obtain target read information includes: For any of the first read data information in the first read information and for any of the first to-be-processed data information in the first read data information, loading stored data information matching the first to-be-processed data information from a data cache area to obtain first loaded data information corresponding to the first to-be-processed data information; parsing the first loaded data information to obtain target loaded data information corresponding to the first data information to be processed; The parsing of the first loaded data information to obtain target loaded data information corresponding to the first data information to be processed includes: Segmenting the first loaded data information to obtain a plurality of sequentially distributed segmented data information; the segmented data information includes frame header information and character information; For any of the segmented data information, parse the frame header information of the segmented data information to obtain a first parsed length value and a second parsed length value; Selecting characters whose number matches the first parsed length value from the character information corresponding to the segmented data information from left to right as the first parsed character information corresponding to the segmented data information; performing conversion processing on the first parsed character information to obtain first target character information corresponding to the segmented data information; Selecting characters whose number matches the second parsed length value from the character information corresponding to the segmented data information from left to right as the second parsed character information corresponding to the segmented data information; performing conversion processing on the second parsed character information to obtain second target character information corresponding to the segmented data information; performing splicing processing on the first target character information and the second target character information to obtain target parsed data information corresponding to the segmented data information; Based on the position sequence relationship of the segmented data information, target parsed data information corresponding to all the segmented data information is spliced ​​to obtain target loaded data information corresponding to the first data information to be processed.

7. A data processing device for high-frequency reading and writing, characterized in that: The device comprises: a memory storing executable program code; a processor coupled to the memory; The processor calls the executable program code stored in the memory to execute the data processing method for high-frequency reading and writing according to any one of claims 1 to 5.

8. A computer-readable storage medium, characterized in that The computer-readable storage medium stores computer instructions, and when the computer instructions are called, they are used to execute the data processing method for high-frequency reading and writing according to any one of claims 1 to 5.

Images