Data reading method and device, electronic equipment, storage medium and program product

By using buffers and paging cardinality to slice data in the database reading method, the problem of excessive memory usage caused by data reading in traditional methods is solved, and more efficient data processing and response time is achieved.

CN120011395APending Publication Date: 2025-05-16CETC JINCANG (BEIJING) TECH CO LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202510072391.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-01-16
Publication Date
2025-05-16

AI Technical Summary

Technical Problem

When reading large amounts of data from a database, traditional methods cause a sharp rise in memory footprint of clients or applications, which can lead to memory overflow errors or significant performance declines.

Method used

By setting buffers and pre-set paging cardinality, the target data is sliced ​​and buffered, reducing frequent access by the receiving object to the database, and allowing data transmission on demand and orderly.

Benefits of technology

It reduces memory usage, reduces processing time, improves data processing throughput, improves the system's concurrent processing capabilities, and shortens the response time of data processing.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120011395A_ABST
    Figure CN120011395A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a data reading method and device, electronic equipment, a storage medium and a program product. The method comprises the following steps: in response to a data reading instruction, extracting target data from a target database corresponding to the data reading instruction, and storing the target data in a buffer area; and based on a preset paging base number, fragmenting the target data in the buffer area, and sequentially sending the fragmented target data to the receiving objects corresponding to the data reading instruction. The method is used for achieving the effects of reducing frequent access of the receiving object to the database and shortening the response time of data processing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the technical field of data storage, and in particular to a data reading method, device, electronic device, storage medium and program product. Background Art

[0002] In the field of modern information technology, databases play a vital role as the core component for storing and managing data. However, when reading large amounts of data from a database, the traditional approach is usually to return all requested data to the client or application at once.

[0003] This approach works well when the amount of data to be returned is small, but it exposes a series of significant defects when facing a large amount of data to be returned. For example, a large influx of data may cause a sharp increase in the memory usage of the client or application, which may lead to memory overflow errors or significant performance degradation, affecting the performance of other network services of the client or application, and seriously affecting the efficiency of data processing. Summary of the invention

[0004] The embodiments of the present application provide a data reading method, device, electronic device, storage medium and program product to achieve the effect of improving the efficiency of data processing.

[0005] In a first aspect, an embodiment of the present application provides a data reading method, comprising:

[0006] In response to a data read instruction, extracting target data from a target database corresponding to the data read instruction and storing the target data in a buffer;

[0007] Based on a preset paging base, the target data in the buffer is segmented, and the segmented target data is sent to the receiving object corresponding to the data reading instruction in sequence.

[0008] In a possible implementation manner, before extracting the target data from the target database corresponding to the data reading instruction and storing it in the buffer, the method further includes:

[0009] Obtaining a target data volume corresponding to the data read instruction;

[0010] The step of extracting target data from a target database corresponding to the data reading instruction and storing the target data in a buffer includes:

[0011] When the target data volume reaches the paging base, target data is determined from the target database according to the target data volume, and a first preset data volume of target data is extracted and stored in the buffer; the first preset data volume is determined based on the maximum storage capacity of the buffer.

[0012] In a possible implementation, the method further includes:

[0013] When the target data volume does not reach the paging base, target data of the target data volume is extracted from the target database and sent to the receiving object.

[0014] In a possible implementation manner, after sending the segmented target data in sequence to the receiving objects corresponding to the data reading instructions, the method further includes:

[0015] When the amount of target data extracted from the target database does not reach the target data amount, based on the free storage space in the buffer zone, target data is continuously extracted from the target database and stored in the buffer zone until all the target data in the target database are stored in the buffer zone.

[0016] In a possible implementation, the continuously extracting target data from the target database and storing it in the buffer based on the free storage space in the buffer includes:

[0017] When the amount of data that can be stored in the free storage space reaches a second preset amount of data, target data of the second preset amount of data is extracted from the target database and stored in the free storage space of the buffer.

[0018] In a possible implementation, the buffer stores the target data in the form of a sliding window.

[0019] In a second aspect, an embodiment of the present application provides a data reading device, including:

[0020] An extraction module, configured to extract target data from a target database corresponding to the data reading instruction and store the target data in a buffer in response to the data reading instruction;

[0021] The sending module is used to slice the target data in the buffer based on a preset paging base, and send the sliced ​​target data to the receiving object corresponding to the data reading instruction in sequence.

[0022] In a third aspect, an embodiment of the present application provides an electronic device, including: a memory, a processor;

[0023] The memory stores computer-executable instructions;

[0024] The processor executes the computer-executable instructions stored in the memory, so that the processor executes the above first aspect and / or various possible implementations of the first aspect.

[0025] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which computer-executable instructions are stored. When the computer-executable instructions are executed by a processor, they are used to implement the first aspect above and / or various possible implementations of the first aspect.

[0026] In a fifth aspect, an embodiment of the present application provides a computer program product, including a computer program, which, when executed by a processor, implements the above first aspect and / or various possible implementation methods of the first aspect.

[0027] The data reading method, device, electronic device, storage medium and program product provided in the embodiments of the present application reduce the frequent access of the receiving object to the database by setting a buffer, ensure that the target data can be transmitted to the receiving object on demand and in an orderly manner, avoid performance bottlenecks caused by the mismatch between the processing speed of the terminal or server corresponding to the database and the receiving object, and by setting the paging base, it is possible to divide the target data with a large data volume into data slices with a smaller data volume, so that the amount of data processed each time can be more controllable, which helps to reduce memory usage, reduce processing time, and improve data processing throughput. Moreover, the target data after slicing can be processed in parallel as independent data units, which helps to improve the concurrent processing capability of the system and shorten the response time of data processing. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0029] Figure 1 A schematic diagram of a scenario of the data reading method provided in this application;

[0030] Figure 2 A schematic diagram of the data reading method provided in this application;

[0031] Figure 3 A schematic diagram of the structure of the data reading device provided by this application;

[0032] Figure 4 A schematic diagram of the structure of the electronic device provided in this application.

[0033] The above drawings have shown clear embodiments of the present application, which will be described in more detail later. These drawings and text descriptions are not intended to limit the scope of the present application in any way, but to illustrate the concept of the present application to those skilled in the art by referring to specific embodiments. DETAILED DESCRIPTION

[0034] Exemplary embodiments will be described in detail herein, examples of which are shown in the accompanying drawings. When the following description refers to the drawings, the same numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present application. Instead, they are merely examples of devices and methods consistent with some aspects of the present application as detailed in the appended claims.

[0035] The data reading method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown, the terminal 102 communicates with the server 104 via the network.

[0036] For example, the data reading method is applied to the terminal 102. After receiving the data reading instruction, the terminal 102 can determine the target database corresponding to the data reading instruction from the data storage system of the server 104, and extract the target data from it and store it in the buffer; further, the terminal 102 can slice the target data in the buffer based on the pre-set paging base, and send the sliced ​​target data to the receiving object corresponding to the data reading instruction in sequence. Among them, the terminal 102 can be but not limited to various personal computers, laptops, smart phones, tablets, Internet of Things devices and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. Portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc. The server 104 can be implemented by an independent server or a server cluster composed of multiple servers. The terminal 102 and the server 104 can be directly or indirectly connected by wired or wireless communication, such as through a network connection.

[0037] For another example, the data reading method is applied to the server 104. After receiving the data reading instruction, the terminal 102 can send the data reading instruction to the server 104. The server 104 can determine the target database corresponding to the data reading instruction from the data storage system, and extract the target data from it and store it in the buffer; further, the server 104 can fragment the target data in the buffer based on the pre-set paging base, and send the fragmented target data to the receiving object corresponding to the data reading instruction in sequence. It can be understood that the data storage system can be an independent storage device, or the data storage system is located on the server 104, or the data storage system is located on another terminal.

[0038] In one embodiment, a data reading method is provided. This embodiment uses the data reading method applied to a terminal as an example for illustration. It is understandable that the data reading method can also be applied to a server, and can also be applied to a system including a terminal and a server, and is implemented through the interaction between the terminal and the server. Figure 2 As shown, the data reading method includes:

[0039] Step 202 : In response to a data read instruction, extract target data from a target database corresponding to the data read instruction and store the target data in a buffer.

[0040] The data read instruction refers to an instruction for obtaining data stored in a specific database.

[0041] Among them, the data reading instruction can be issued by the user through the human-computer interaction interface of the terminal. The human-computer interaction interface of the terminal can specifically display the platform interface pre-specified by the service provider. The staff issues the data reading instruction by clicking on a specific component on the specified platform interface. It should be noted that the user can also issue data reading instructions for different databases by clicking on pre-integrated components for indicating different databases on the specified platform interface.

[0042] The target data refers to data that another terminal or another server that issues the data read instruction wants to read from the data storage system of the server.

[0043] A buffer refers to a driver cache in a data storage system that is used to temporarily store target data. It is usually used to provide a smooth data flow between a terminal or server and another terminal or server that issues the data read instruction. In particular, when the processing speed of the terminal or server does not match that of the other terminal or server that issues the data read instruction, the buffer can help reduce the risk of data loss, improve the efficiency of data processing, and optimize the use of system resources.

[0044] Step 204 : segment the target data in the buffer based on a preset paging base, and send the segmented target data to the receiving objects corresponding to the data read instructions in sequence.

[0045] The paging cardinality is a preset value. During the data segmentation process, the paging cardinality determines the amount of target data sent to the receiving object, ie, the terminal, each time.

[0046] As an example, the terminal can use the memory resources of the space to create a buffer in advance in the data storage system of the server. When the data read instruction is issued for a data set (dataset) of an application, the terminal extracts the target data of the target database from the data storage system according to the data read instruction of the dataset into the buffer, and then slices the target data in the buffer, and sends the sliced ​​target data to the dataset to complete the data reading. As an example, a dataset is a collection of data, usually in the form of a table, each column represents a specific variable or attribute, and each row corresponds to the data of a member or record in the dataset. The target database is, for example, a query table, and multiple data are stored in the query table.

[0047] It should be noted that the buffer can be implemented in the form of a sliding window.

[0048] The above data reading method, by setting a buffer and using the buffer as an intermediate storage layer, can not only reduce the frequent access of the receiving object to the database, but also help to smooth the data flow, ensure that the target data can be transmitted to the receiving object on demand and in an orderly manner, and avoid performance bottlenecks caused by the mismatch between the processing speed of the terminal or server corresponding to the database and the receiving object. Users can also dynamically adjust the size of the paging base according to the network conditions, thereby realizing customized control of the data transmission speed; and by setting the paging base, the target data with a large data volume can be divided into data slices with a smaller data volume, which can make the amount of data processed each time more controllable. This helps to reduce memory usage, reduce processing time, and improve the throughput of data processing. In addition, the target data after slicing can be processed in parallel as independent data units, which helps to improve the concurrent processing capability of the system and shorten the response time of data processing.

[0049] In some optional embodiments, before extracting the target data from the target database corresponding to the data reading instruction and storing it in the buffer, the method further includes:

[0050] Obtaining the target data volume corresponding to the data reading instruction;

[0051] The step of extracting target data from a target database corresponding to a data read instruction and storing the target data in a buffer includes:

[0052] When the target data volume reaches the paging base, the target data is determined from the target database according to the target data volume, and the target data of a first preset data volume is extracted and stored in the buffer; the first preset data volume is determined based on the maximum storage capacity of the buffer.

[0053] The target data volume corresponding to the data read instruction refers to the total amount or size of data that the receiving object intends to retrieve or read from the target database. This data volume can be measured in the form of number of records, number of bytes, number of data blocks, etc.

[0054] The maximum storage capacity of the buffer refers to the maximum amount of data that the buffer can store, that is, the first preset data amount. The first preset data amount can be measured based on bytes, the number of records, the number of data blocks, etc. Once the amount of data stored in the buffer reaches the first preset data amount, some measures need to be taken, such as suspending data writing, sending data to the receiving object, etc., to avoid data overflow.

[0055] In another embodiment, the data reading method further includes:

[0056] When the target data volume does not reach the paging base, the target data volume of target data is extracted from the target database and sent to the receiving object.

[0057] Using a buffer requires additional memory resources to store the target data. When the target data volume corresponding to the data read instruction is less than the paging base, it means that the target data volume is small, and the cost of using additional memory resources to buffer and flatten the target data may not be cost-effective. Therefore, the terminal can send the target data directly to the receiving object.

[0058] In this embodiment, when the target data volume corresponding to the data reading instruction is less than the paging base, the terminal can directly send the target data to the receiving object, thereby reducing the waiting time of the target data in the buffer, speeding up the data transmission speed, reducing the data processing steps, and reducing the complexity of the system, thereby making the data reading method in this embodiment easier to implement and maintain. When the target data volume corresponding to the data reading instruction is greater than the paging base, the use of the buffer to store the target data is triggered to transmit the target data to the receiving object on demand and in an orderly manner.

[0059] In some optional embodiments, after step 204, the following further steps are included:

[0060] When the amount of target data extracted from the target database does not reach the target data amount, the target data is continuously extracted from the target database and stored in the buffer based on the free storage space of the buffer until all the target data in the target database is stored in the buffer.

[0061] As an example, when the first preset data volume of the buffer is 200kb and the target data volume corresponding to the data reading instruction is 500kb, the terminal stores 200kb of target data that meets the first preset data volume into the buffer in step 202. As the terminal sends the 200kb target data in the buffer to the receiving object in sequence, free storage space will appear in the buffer. At this time, the terminal determines that the data volume of the target data stored in the buffer, 200kb, does not reach the target data volume of 500kb, and continues to extract the target data and store it in the buffer until the data volume of the target data stored in the buffer reaches the target data volume of 500kb.

[0062] Furthermore, the data reading method includes:

[0063] When the amount of data that can be stored in the free storage space reaches a second preset amount of data, target data of the second preset amount of data is extracted from the target database and stored in the free storage space of the buffer.

[0064] In this embodiment, the terminal can monitor the size of the free storage space in the buffer. When the amount of data that can be stored in the free storage space reaches a second preset data amount, it triggers the target data in the target database to be stored in the buffer, thereby avoiding frequent interactions with the target database and avoiding waste of resources.

[0065] In another embodiment, after sharding the target data stored in the buffer, the terminal can also perform concurrent processing on the sharded target data. At this time, it is necessary to determine the number of shards. At this time, the actual amount of target data in the buffer can be divided by the paging base and rounded up to obtain the number of shards.

[0066] Through the above processing, the target data stored in the buffer can be segmented at one time, so that the data segments can be processed in parallel as independent data units, which helps to improve the concurrent processing capability of the system and shorten the response time of data processing.

[0067] In a more specific embodiment, a data storage system on the service provider side corresponding to a specific application can store multiple table data, and the maximum storage capacity of the buffer indicates that the buffer can store 200 table data, and the paging base corresponds to 50 table data. The user sends a data read instruction to the terminal on the service provider side corresponding to the application through the terminal carried by the application. The data read instruction can be used to extract 500 table data from the target database of the data storage system. After receiving the data read instruction, the terminal on the service provider side can use the 500 table data in the target database of the data storage system as the target data. At this time, the terminal can determine that the target data volume 500 of the data read instruction reaches the paging base 50, and then it can trigger the call buffer to store the 200 table data in the buffer first. Further, according to the paging base, the 200 table data in the buffer are fragmented, and the generated fragmented data corresponds to 50 table data, and the fragmented target data is sent to the terminal carried by the application.

[0068] Alternatively, when the maximum storage capacity of the buffer indicates that the buffer can store 200 pieces of table data, the paging base corresponds to 50 pieces of table data, and the data reading instruction is used to extract 10 pieces of table data from the target database of the data storage system, the terminal can determine that the target data volume 10 of the data reading instruction does not reach the paging base 50, and directly send the 10 pieces of table data in the target database as target data to the terminal equipped with the application.

[0069] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0070] Based on the same inventive concept, the embodiment of the present application also provides a data reading device for implementing the data reading method involved above. The implementation solution provided by the data reading device to solve the problem is similar to the implementation solution recorded in the above data reading method, so the specific limitations of one or more device embodiments provided below can refer to the limitations of the data reading method above, and will not be repeated here.

[0071] In one embodiment, Figure 3 As shown, a data reading device 300 is provided, comprising:

[0072] An extraction module 302 is used to extract target data from a target database corresponding to the data reading instruction and store the target data in a buffer in response to the data reading instruction;

[0073] The sending module 304 is used to segment the target data in the buffer based on a preset paging base, and send the segmented target data to the receiving objects corresponding to the data reading instructions in sequence.

[0074] In some optional embodiments, the extraction module 302 is further configured to:

[0075] Obtaining the target data volume corresponding to the data reading instruction;

[0076] When the target data volume reaches the paging base, the target data is determined from the target database according to the target data volume, and the target data of a first preset data volume is extracted and stored in the buffer; the first preset data volume is determined based on the maximum storage capacity of the buffer.

[0077] In some optional embodiments, the extraction module 302 is further configured to:

[0078] When the target data volume does not reach the paging base, the target data volume of target data is extracted from the target database and sent to the receiving object.

[0079] In some optional embodiments, the sending module 304 is further configured to:

[0080] When the amount of target data extracted from the target database does not reach the target data amount, the target data is continuously extracted from the target database and stored in the buffer based on the free storage space of the buffer until all the target data in the target database is stored in the buffer.

[0081] In some optional embodiments, the sending module 304 is further configured to:

[0082] When the amount of data that can be stored in the free storage space reaches a second preset amount of data, target data of the second preset amount of data is extracted from the target database and stored in the free storage space of the buffer.

[0083] In some optional embodiments, the buffer stores the target data in the form of a sliding window.

[0084] Each module in the above device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module above.

[0085] Figure 4 This is a schematic diagram of the structure of the (device subject) provided in this application. Figure 4 As shown, the electronic device 40 provided in this embodiment includes: at least one processor 401 and a memory 402. Optionally, the device 40 also includes a communication component 403. The processor 401, the memory 402 and the communication component 403 are connected via a bus 404.

[0086] In a specific implementation process, at least one processor 401 executes the computer-executable instructions stored in the memory 402, so that at least one processor 401 executes the above method.

[0087] The specific implementation process of the processor 401 can be found in the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be repeated here.

[0088] In the above embodiments, it should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the invention may be directly implemented as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.

[0089] The memory may include a high-speed memory (Random Access Memory, RAM), and may also include a non-volatile memory (Non-volatile Memory, NVM), such as at least one disk memory.

[0090] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0091] The present application also provides a computer program product, including a computer program, which implements the above method when executed by a processor.

[0092] The present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the above method is implemented.

[0093] The above-mentioned readable storage medium can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general or special-purpose computer.

[0094] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (Application Specific Integrated Circuits, referred to as: ASIC). Of course, the processor and the readable storage medium can also exist in the device as discrete components.

[0095] The division of units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be an indirect coupling or communication connection through some interface, device or unit, which can be electrical, mechanical or other forms.

[0096] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0097] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0098] If the function is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods of each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0099] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.

[0100] Finally, it should be noted that those skilled in the art will readily conceive of other embodiments of the present invention after considering the specification and practicing the invention disclosed herein. The present invention is intended to cover any variations, uses or adaptations of the present invention, which follow the general principles of the present invention and include common knowledge or customary technical means in the art not disclosed by the present invention, are not limited to the precise structure described above and shown in the drawings, and may be modified and changed in various ways without departing from the scope thereof. The scope of the present invention is limited only by the appended claims.

Claims

1. A data reading method, characterized in that: include: In response to a data read instruction, extracting target data from a target database corresponding to the data read instruction and storing the target data in a buffer; Based on a preset paging base, the target data in the buffer is segmented, and the segmented target data is sent to a receiving object corresponding to the data read instruction.

2. The method according to claim 1, characterized in that Before extracting the target data from the target database corresponding to the data reading instruction and storing it in the buffer, the method further includes: Obtaining a target data volume corresponding to the data read instruction; The step of extracting target data from a target database corresponding to the data reading instruction and storing the target data in a buffer includes: When the target data volume reaches the paging base, target data is determined from the target database according to the target data volume, and a first preset data volume of target data is extracted and stored in the buffer; the first preset data volume is determined based on the maximum storage capacity of the buffer.

3. The method according to claim 2, characterized in that The method further comprises: When the target data volume does not reach the paging base, target data of the target data volume is extracted from the target database and sent to the receiving object.

4. The method according to claim 2, characterized in that: After sending the segmented target data to the receiving objects corresponding to the data reading instructions in sequence, the method further includes: When the amount of target data extracted from the target database does not reach the target data amount, based on the free storage space in the buffer zone, target data is continuously extracted from the target database and stored in the buffer zone until all the target data in the target database are stored in the buffer zone.

5. The method according to claim 4, characterized in that The step of continuously extracting target data from the target database and storing the target data in the buffer based on the free storage space in the buffer includes: When the amount of data that can be stored in the free storage space reaches a second preset amount of data, target data of the second preset amount of data is extracted from the target database and stored in the free storage space of the buffer.

6. The method according to claim 1, characterized in that The buffer stores the target data in the form of a sliding window.

7. A data reading device, characterized in that: include: An extraction module, configured to extract target data from a target database corresponding to the data reading instruction and store the target data in a buffer in response to the data reading instruction; The sending module is used to slice the target data in the buffer based on a preset paging base, and send the sliced ​​target data to the receiving object corresponding to the data reading instruction in sequence.

8. An electronic device, characterized in that: include: Memory, processor; The memory stores computer-executable instructions; The processor executes the computer-executable instructions stored in the memory, so that the processor performs the method according to any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, which are used to implement the method according to any one of claims 1 to 6 when executed by a processor.

10. A computer program product, characterized in that The invention comprises a computer program, which implements the method according to any one of claims 1 to 6 when being executed by a processor.

Citation Information

Cited By

  • Data-based report type data synchronization method and device

    CN120336433A