Data processing method, device, system, electronic device, and storage medium

Abstract

The present disclosure relates to a data processing method, device, system, computer device and storage medium. The method comprises: in the case of listening to an agent process updating a data set file corresponding to a service process, performing in-memory mapping on the updated target data set file to obtain a virtual memory address of the target data set file; releasing data in an original data set file in a physical memory of the service process; and writing data in the target data set file into the physical memory according to the virtual memory address of the target data set file. The embodiment of the present disclosure can reduce memory consumption.

Description

Technical Field

[0001] This disclosure relates to the field of data processing technology, and in particular to a data processing method, apparatus, system, electronic device, and storage medium. Background Technology

[0002] When data rotation is involved in a process, the process typically loads the new data from the updated target data set file into the process's physical memory, and then releases the old data from the original data set file from the process's physical memory. This results in a brief period where new and old data coexist, consuming physical memory and wasting space, potentially causing spikes in physical memory usage.

[0003] In some container environments with limited memory, processes may be terminated by the Out Of Memory killer (OOM killer) due to peak memory consumption, which can significantly reduce the availability and stability of the services corresponding to those processes. Summary of the Invention

[0004] This disclosure provides a data processing method, apparatus, system, electronic device, and storage medium to at least solve the problem of memory consumption spikes during data rotation in related technologies. The technical solution of this disclosure is as follows:

[0005] According to a first aspect of the present disclosure, a data processing method is provided, applied to a business process, including:

[0006] When it is detected that the agent process is updating the data set file corresponding to the business process, memory mapping is performed on the updated target data set file to obtain the virtual memory address of the target data set file;

[0007] Release the data from the original data set file in the physical memory of the business process;

[0008] Based on the virtual memory address of the target data set file, the data in the target data set file is written into the physical memory.

[0009] In one possible implementation, the step of performing memory mapping on the updated target data set file to obtain the virtual memory address of the target data set file when an update to the data set file corresponding to the business process is detected by the proxy process includes:

[0010] Monitor the linked file, which is used to record the disk location of the data set file corresponding to the business process on the disk.

[0011] If the update of the linked file is detected, it is determined that the data set file corresponding to the business process has been updated, and the first disk location of the updated target data set file on the disk is obtained from the linked file.

[0012] Based on the first disk location, the target data set file is memory-mapped to obtain the virtual memory address of the target data set file.

[0013] In one possible implementation, writing data from the target data set file into the physical memory based on the virtual memory address of the target data set file includes:

[0014] Access the data in the target data set file based on the virtual memory address of the target data set file;

[0015] If the data to be accessed in the target data set file has not been written to the physical memory, a page fault mechanism is used to write the data to be accessed into the physical memory.

[0016] In one possible implementation, before performing memory mapping on the updated target data set file to obtain the virtual memory address of the target data set file upon detecting an update of the data set file corresponding to the business process by the proxy process, the method further includes:

[0017] Obtain the second disk location of the original data set file from the linked file;

[0018] Based on the second disk location, the original data set file is memory-mapped to obtain the virtual memory address of the original data set file;

[0019] Access the data in the original data set file based on the virtual memory address of the original data set file;

[0020] If the data to be accessed in the original data set file has not been written to the physical memory, a page fault interrupt mechanism is used to write the data to be accessed in the original data set file to the physical memory.

[0021] According to a second aspect of the present disclosure, a data processing method is provided, applied to an agent process, comprising:

[0022] Monitor the data collection storage area;

[0023] Upon detecting an update to the data set file for a business process in the data set storage area, the target data set file is read from the data set storage area.

[0024] The business process updates the data set file corresponding to the target data set file according to the target data set file, so that after the data set file is updated, the business process performs memory mapping on the target data set file, and after releasing the data in the original data set file in the physical memory of the business process, writes the data in the target data set file into the physical memory according to the virtual memory address of the target data set file obtained through the memory mapping.

[0025] In one possible implementation, updating the data set file corresponding to the business process based on the target data set file includes:

[0026] The target data set file is stored on a disk to obtain the first disk location of the target data set file;

[0027] The location information in the linked file is updated to the first disk location, wherein the linked file is used to record the disk location of the data set file corresponding to the business process on the disk.

[0028] According to a third aspect of the embodiments of this disclosure, a data processing system is provided, the system comprising a business process and an agent process, wherein...

[0029] When the agent process detects an update to the data set file for the business process in the data set storage area, it retrieves the target data set file from the data set storage area and updates the data set file corresponding to the business process based on the target data set file.

[0030] When the business process determines that the agent process updates the data set file corresponding to the business process, it performs memory mapping on the updated target data set file to obtain the virtual memory address of the target data set file.

[0031] After the business process releases the data from the original data set file from the physical memory of the business process, it writes the data from the target data set file into the physical memory according to the virtual memory address in the target data set file.

[0032] In one possible implementation, the agent process stores the target data set file on the disk, obtains the first disk location of the target data set file, and updates the location information in the linked file to the first disk location. The linked file is used to record the disk location of the data set file corresponding to the business process on the disk.

[0033] In one possible implementation, the business process listens to the linked file, and when it detects an update to the linked file, it obtains the first disk location of the updated target data set file on the disk from the linked file, and performs memory mapping on the target data set file based on the first disk location to obtain the virtual memory address of the target data set file.

[0034] In one possible implementation, the business process accesses the data in the target data set file based on the virtual memory address of the target data set file, and if the data to be accessed in the target data set file has not been written to the physical memory, a page fault interrupt mechanism is used to write the data to be accessed into the physical memory.

[0035] In one possible implementation, after the business process obtains the second disk location of the original data set file on the disk from the link file, it performs memory mapping on the original data set file according to the second disk location to obtain the virtual memory address of the original data set file.

[0036] The business process accesses the data in the original data set file based on the virtual memory address of the original data set file, and if the data to be accessed in the original data set file has not been written to the physical memory, a page fault interrupt mechanism is used to write the data to be accessed in the original data set file to the physical memory.

[0037] According to a fourth aspect of the present disclosure, a data processing apparatus is provided, applied to a business process, comprising:

[0038] The first mapping unit is configured to perform memory mapping on the updated target data set file to obtain the virtual memory address of the target data set file when the agent process is detected updating the data set file corresponding to the business process.

[0039] The release unit is configured to release data from the original data set file in the physical memory of the business process;

[0040] The first writing unit is configured to write data from the target data set file into the physical memory according to the virtual memory address of the target data set file.

[0041] In one possible implementation, the first mapping unit includes:

[0042] The listening subunit is configured to listen to a linked file, which is used to record the disk location of the data set file corresponding to the business process on the disk.

[0043] The determination subunit is configured to, upon detecting an update to the linked file, determine an update to the data set file corresponding to the business process, and obtain the first disk location of the updated target data set file on the disk from the linked file.

[0044] The mapping subunit is configured to perform memory mapping on the target data set file based on the first disk location to obtain the virtual memory address of the target data set file.

[0045] In one possible implementation, the first writing unit includes:

[0046] The access subunit is configured to perform access to data in the target data set file based on the virtual memory address of the target data set file;

[0047] The write subunit is configured to write the data to be accessed into the physical memory using a page fault mechanism if the data to be accessed in the target data set file has not been written into the physical memory.

[0048] In one possible implementation, the data processing apparatus further includes:

[0049] The acquisition unit is configured to retrieve the second disk location of the original data set file on the disk from the linked file;

[0050] The second mapping unit is configured to perform memory mapping on the original data set file according to the second disk location to obtain the virtual memory address of the original data set file;

[0051] The access unit is configured to perform access to data in the original data set file based on the virtual memory address of the original data set file;

[0052] The second write unit is configured to write the data to be accessed in the original data set file to the physical memory using a page fault interrupt mechanism if the data to be accessed in the original data set file has not been written to the physical memory.

[0053] According to a fifth aspect of the present disclosure, a data processing apparatus is provided for use in an agent process, comprising:

[0054] The listening unit is configured to listen to the data set storage area.

[0055] The reading unit is configured to read the target data set file from the data set storage area when an update to the data set file for the business process is detected in the data set storage area.

[0056] The update unit is configured to update the data set file corresponding to the business process according to the target data set file, so that after the data set file is updated, the business process performs memory mapping on the target data set file, and after releasing the data in the original data set file in the physical memory of the business process, writes the data in the target data set file into the physical memory according to the virtual memory address of the target data set file obtained through the memory mapping.

[0057] In one possible implementation, the update unit includes:

[0058] The storage subunit is configured to perform the operation of storing the target data set file on a disk, thereby obtaining the first disk location of the target data set file;

[0059] The update subunit is configured to update the location information in the linked file to the first disk location, wherein the linked file is used to record the disk location of the data set file corresponding to the business process on the disk.

[0060] According to a sixth aspect of the present disclosure, an electronic device is provided, comprising:

[0061] processor;

[0062] Memory used to store the processor's executable instructions;

[0063] The processor is configured to execute the instructions to implement the data processing method described in any of the preceding claims.

[0064] According to a seventh aspect of the present disclosure, a computer-readable storage medium is provided that, when instructions in the computer-readable storage medium are executed by a processor of an electronic device, enables the electronic device to perform the data processing method as described in any of the preceding claims.

[0065] According to an eighth aspect of the present disclosure, a computer program product is provided, the computer program product including instructions that, when executed by a processor of an electronic device, enable the electronic device to perform the data processing method as described in any of the preceding claims.

[0066] The technical solutions provided by the embodiments of this disclosure bring at least the following beneficial effects:

[0067] The aforementioned data processing method, apparatus, system, electronic device, and storage medium update the data set file corresponding to the business process through a proxy process. The business process maps the updated target data set file to itself via memory mapping. At this point, the business process obtains the updated target data set file but does not access the data in the target data set file; that is, the target data set file does not actually occupy the physical memory of the business process. After releasing the data in the original data set file from physical memory, the business process writes the data in the target data set file into its own physical memory. Based on the data processing method, apparatus, system, electronic device, and storage medium provided in this disclosure, the coexistence of the target data set file and the data in the original target data set file in the physical memory of the business process can be avoided during data rotation. This reduces memory consumption, prevents memory consumption spikes caused by the coexistence phenomenon, and thus ensures the availability and stability of the services corresponding to the process.

[0068] It should be understood that the above general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Attached Figure Description

[0069] The accompanying drawings, which are incorporated in and form part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure, and are not intended to unduly limit this disclosure.

[0070] Figure 1 This is a flowchart illustrating a data processing method according to an exemplary embodiment;

[0071] Figure 2 This is a flowchart illustrating a data processing method according to an exemplary embodiment;

[0072] Figure 3 This is a flowchart illustrating a data processing method according to an exemplary embodiment;

[0073] Figure 4 This is a flowchart illustrating a data processing method according to an exemplary embodiment;

[0074] Figure 5 This is a flowchart illustrating a data processing method according to an exemplary embodiment;

[0075] Figure 6 This is a flowchart illustrating a data processing method according to an exemplary embodiment;

[0076] Figure 7 This is a block diagram illustrating a data processing system according to an exemplary embodiment;

[0077] Figure 8 This is a schematic diagram illustrating a data processing method according to an exemplary embodiment;

[0078] Figures 9a to 9b This is a schematic diagram illustrating a data processing system according to an exemplary embodiment;

[0079] Figure 10 This is a block diagram illustrating a data processing apparatus according to an exemplary embodiment;

[0080] Figure 11 This is a block diagram illustrating a data processing apparatus according to an exemplary embodiment;

[0081] Figure 12 This is a block diagram illustrating an electronic device according to an exemplary embodiment. Detailed Implementation

[0082] To enable those skilled in the art to better understand the technical solutions of this disclosure, the technical solutions in the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings.

[0083] It should be noted that the terms "first," "second," etc., used in the specification, claims, and accompanying drawings of this disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that such data can be interchanged where appropriate so that the embodiments of this disclosure described herein can be implemented in orders other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with this disclosure. Rather, they are merely examples of apparatuses and methods consistent with some aspects of this disclosure as detailed in the appended claims.

[0084] It should also be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for display, data used for analysis, etc.) involved in this disclosure are all information and data authorized by the user or fully authorized by all parties.

[0085] In one embodiment, such as Figure 1 As shown, a data processing method is provided. This embodiment illustrates the method applied to a terminal, but it is understood that the method can also be applied to a server, or to a system including both a terminal and a server, and implemented through interaction between the terminal and the server. In this embodiment, the method includes the following steps:

[0086] In step 102, when it is detected that the agent process is updating the data set file corresponding to the business process, memory mapping is performed on the updated target data set file to obtain the virtual memory address of the target data set file.

[0087] In this embodiment, both the proxy process and the business process are processes within the terminal and / or server. The proxy process monitors the data set storage area, which stores the data set files corresponding to the business processes. Upon detecting an update to the data set file corresponding to the business process within the data set storage area, the proxy process retrieves the updated target data set file from that area. It then constructs the data on the disk according to the target data set file, storing it in a specified directory format. The proxy process also writes the target data set file to a link file at a first disk location. This link file stores the address of the data set file used by the business process; that is, the link file currently points to the target data set file through this first disk location.

[0088] For example, suppose the business process is a process that implements IP query services. Before the update, the business process performs IP query services based on the data in the original data set file. Taking IP address 1 as an example, the query finds that the address corresponding to IP address 1 is province A. The IP query service undergoes a version update. During this update, the data set file (IPv4) for the IP query service is updated. In the updated target data set file (IPv6), the address corresponding to IP address 1 is city B in province A. Therefore, IPV4 is the original data set file, and IPV6 is the target data set file. After data rotation, the data set file for the business process in the data set storage area is updated from IPV4 to IPV6. The agent process then detects the update operation in the data set storage area for the business process's data set file and can read the updated target data set file (IPv6) and store it on disk.

[0089] After the agent process updates the data set file corresponding to the business process, the business process can use system calls such as open / shm_open and mmap to perform memory mapping on the target data set file, mapping the target data set file into the memory of the business process, realizing the correspondence between the first disk location of the target data set file and a segment of virtual memory address in the virtual address space of the business process, and obtaining the virtual memory address of the target data set file.

[0090] In step 104, the data in the original data set file in the physical memory of the business process is released.

[0091] In this embodiment, after obtaining the virtual memory address of the target data set file, the business process believes it has obtained the updated target data set file. However, in reality, the business process does not perform any memory access operations on the target data set file at this time. Therefore, the target data set file is not written into the physical memory of the business process and thus does not actually occupy physical memory. At this point, the business process can release the data in the original data set file stored in physical memory. This original data set file is the data set file used by the business process before data rotation.

[0092] In step 106, the data in the target data set file is written into physical memory according to the virtual memory address of the target data set file.

[0093] In this embodiment of the disclosure, after releasing the data in the original data set file stored in the physical memory of the business process, the data in the target data set file can be accessed according to the virtual memory address of the target data set file in order to write the data in the target data set file into the physical memory.

[0094] The aforementioned data processing method updates the data set file corresponding to the business process through a proxy process. The business process maps the updated target data set file to itself via memory mapping. At this point, the business process obtains the updated target data set file but does not access the data in the target data set file; that is, the target data set file does not actually occupy the physical memory of the business process. After releasing the data in the original data set file from physical memory, the business process writes the data in the target data set file into its own physical memory. Based on the data processing method provided in this disclosure, the coexistence of the target data set file and the data in the original target data set file in the physical memory of the business process can be avoided during data rotation. This reduces memory consumption, avoids memory consumption spikes caused by the aforementioned coexistence, and thus ensures the availability and stability of the services corresponding to the process.

[0095] In one exemplary embodiment, such as Figure 2 As shown, in step 102, when it is detected that the agent process is updating the data set file corresponding to the business process, memory mapping is performed on the updated target data set file to obtain the virtual memory address of the target data set file. This can be achieved through the following steps:

[0096] In step 202, the linked file is monitored. The linked file is used to record the disk location of the data set file corresponding to the business process on the disk.

[0097] In step 204, if an update to the linked file is detected, it is determined that the data set file corresponding to the business process has been updated, and the first disk location of the updated target data set file on the disk is obtained from the linked file.

[0098] In step 206, the target data set file is memory-mapped according to the first disk location to obtain the virtual memory address of the target data set file.

[0099] In this embodiment of the disclosure, the link file is a file used to record the disk location of the data set file used by the business process on the disk. That is, the link file always points to the data set file used by the business process according to the recorded disk location. For example, the link file can be a link file.

[0100] Before an update operation is performed, the linked file records the second disk location of the original data set file used by the business process before the update.

[0101] After obtaining the target data set file, the agent process can store the target data set file on the disk according to the specified directory format, obtain the first disk location of the target data set file on the disk, and update the disk location of the data set file used by the business process in the linked file from the second disk location to the first disk location. After the update, the linked file points to the target data set file according to the first disk location.

[0102] The business process can monitor the linked file in real time or periodically. After detecting that the linked file has been updated, it can be determined that the data set file corresponding to the business process has been updated. Then, the first disk location of the current record can be obtained from the linked file, and the target data set file stored at the first disk location can be memory-mapped using system calls such as open / shm_open and mmap. This will give the virtual memory address of the target data set file in the virtual memory space of the business process.

[0103] According to the data processing method provided in this disclosure, the data set file used by the business process is updated and constructed through a proxy process. The business process and the proxy process communicate through a link file, so that the business process can obtain the updated target data set through the proxy process without the business process updating and constructing the data set file. That is, the target data set file does not occupy the memory space of the business process during the update and construction process. This can avoid the phenomenon that the data in the target data set file and the original target data set file coexist in the physical memory of the business process during data rotation, thereby reducing memory consumption and avoiding the occurrence of memory consumption spikes caused by the above coexistence phenomenon. In this way, the availability and stability of the service corresponding to the process can be guaranteed.

[0104] In one exemplary embodiment, such as Figure 3 As shown, in step S106, writing the data from the target data set file into physical memory according to the virtual memory address of the target data set file can be achieved through the following steps:

[0105] In step 302, the data in the target data set file is accessed according to the virtual memory address of the target data set file;

[0106] In step 304, if the data to be accessed in the target data set file has not been written to physical memory, a page fault mechanism is used to write the data to be accessed into physical memory.

[0107] In this embodiment of the disclosure, after obtaining the virtual memory address of the target data set file, the business process can access the data in the target data set file based on the virtual memory address. For example, the memory mapping process can obtain the starting address and length of the virtual memory of the target data set file in the business process's virtual memory space. The business process can determine the virtual memory address of the data in the target data set file in the virtual memory space based on the starting address and length of the virtual memory. The business process can also determine the disk location of the data in the target data set file to be accessed on the disk based on the virtual memory address.

[0108] After determining the target virtual memory address corresponding to the data to be accessed, the business process can check if the target physical memory address corresponding to that virtual memory address exists in the address mapping table. The address mapping table is a table of virtual memory addresses and physical memory addresses obtained after the MMU (Memory Management Unit) performs the translation from virtual memory address to physical memory address (that is, writes the data pointed to by the virtual memory address into the physical memory at the location pointed to by the physical memory address). If the target physical memory address corresponding to the target virtual memory address exists in the address mapping table, it can be determined that the data to be accessed corresponding to that target virtual memory address has been written into physical memory. Therefore, the data to be accessed can be directly accessed from physical memory to perform the corresponding operation based on the target physical memory address corresponding to the target virtual memory address.

[0109] Alternatively, if the target physical memory address corresponding to the target virtual memory address does not exist in the address mapping table, it can be determined that the data to be accessed has not yet been written to physical memory, and a page fault mechanism will be triggered. The interrupt response function in the page fault mechanism will search for the corresponding target physical memory address in the swap partition (swap area), where the swap partition is used to store data swapped out from physical memory. If the corresponding target physical memory address is not found in the swap partition (that is, if the data to be accessed has never been read into physical memory), the data to be accessed will be stored from the disk into physical memory through the mapping relationship between the first disk location and the virtual memory address established by the memory mapping above. For example, the business process can determine the target physical memory address corresponding to the target virtual memory address through the MMU, write the data to be accessed into the physical memory of the business process according to the target physical memory address, and write the mapping relationship between the target virtual memory address and the target physical memory address into the address mapping table mentioned above.

[0110] It should be noted that the data to be accessed can be data pointed to by a target virtual memory address randomly determined from the virtual memory address. That is, the business process randomly accesses the data according to the virtual memory address and writes the data to be accessed into the physical memory through the page fault interrupt mechanism. This process is repeated until all the data in the target data set file is written into the physical memory of the business process.

[0111] According to the data processing method provided in this disclosure, the data set file used by the business process is updated through a proxy process. This eliminates the need for the proxy process to update the data set file itself. After the proxy process completes the storage of the target data set file, the business process can write the data from the target data set file into physical memory via a page fault mechanism, thus enabling data updates for the business process in data rotation scenarios. Based on the data processing method provided in this disclosure, the coexistence of data from the target data set file and the original target data set file in the physical memory of the business process during data rotation can be avoided. This reduces memory consumption, prevents memory consumption spikes caused by the coexistence phenomenon, and ultimately ensures the availability and stability of the services corresponding to the process.

[0112] In one exemplary embodiment, such as Figure 4 As shown, in step S102, before detecting an update to the data set file corresponding to the business process by the agent process, and before performing memory mapping on the updated target data set file to obtain the virtual memory address of the target data set file, the above data processing method may further include:

[0113] In step 402, the second disk location of the original data set file on the disk is obtained from the linked file;

[0114] In step 404, the original data set file is memory-mapped according to the second disk location to obtain the virtual memory address of the original data set file;

[0115] In step 406, the data in the original data set file is accessed based on the virtual memory address of the original data set file;

[0116] In step 408, if the data to be accessed in the original data set file has not been written to the physical memory, a page fault interrupt mechanism is used to write the data to be accessed in the original data set file into the physical memory.

[0117] For example, during business process initialization, the data set file is still written through the proxy process. That is, the proxy process reads the original data set file used by the business process and writes it to disk, obtaining the second disk location of the original data set file, and then writes this second disk location to the linked file. In other words, the current linked file points to the original data set file through this second disk location. When the business process detects data being written to the linked file, it obtains the second disk location of the original data set file from the linked file, uses system calls such as open / shm_open and mmap to perform memory mapping on the original data set file stored at the second disk location, and thus obtains the virtual memory address of the original data set file in the business process's virtual memory space.

[0118] The data in the original data set file is accessed based on its virtual memory address. If the data to be accessed in the original data set file has not yet been written to the physical memory of the business process, a page fault mechanism can be triggered to write the data to be accessed in the original data set file into physical memory. The specific process is the same as the process of writing data from the target data set file into physical memory described above, and will not be repeated here.

[0119] The data processing method provided in this disclosure uses a proxy process to update and construct the data set file used by the business process, eliminating the need for the business process to update and construct the data set file, making the business process more lightweight and significantly reducing its memory consumption.

[0120] In one embodiment, such as Figure 5As shown, a data processing method is provided. This embodiment illustrates the method applied to a terminal, but it is understood that the method can also be applied to a server, or to a system including both a terminal and a server, and implemented through interaction between the terminal and the server. In this embodiment, the method includes the following steps:

[0121] In step 502, the data collection storage area is monitored.

[0122] In this embodiment of the disclosure, the data set storage area is used to store the data set files used by the business processes. The agent process can monitor the data set storage area in real time or periodically to determine whether the data set files used by the business processes have been updated.

[0123] In step 504, if an update to the data set file for the business process is detected in the data set storage area, the target data set file is read from the data set storage area.

[0124] In this embodiment of the disclosure, the data set file used by the business process before the update is the original data set file. When the data set file used by the business process in the data set storage area is updated from the original data set file to the target data set file, the agent process detects that the data set file for the business process in the data set storage area has been updated, and can then read the updated target data set file from the data set storage area.

[0125] In step 506, the data set file corresponding to the business process is updated according to the target data set file, so that after the data set file is updated, the business process performs memory mapping on the target data set file, and after releasing the data in the original data set file in the physical memory of the business process, the data in the target data set file is written into the physical memory according to the virtual memory address of the target data set file obtained through memory mapping.

[0126] For example, after reading the target data set file, the agent process can construct data on the disk based on the target data set file. This means writing the target data set file to the disk according to a specified directory format, and updating the disk location of the data set file used by the business process in the linked file from the second disk location corresponding to the original data set file to the first disk location corresponding to the target data set file. This changes the linked file from pointing to the original data set file to pointing to the target data set file. After the linked file is changed, the business process can obtain the first disk location of the target data set file based on the linked file. Then, it performs memory mapping on the target data set file based on this first disk location to obtain the virtual memory address in the target data set file. After releasing the data of the original data set file from physical memory, it accesses the data in the target data set file based on the virtual memory address, thus writing the data in the target data set file into physical memory. The specific process is described in the foregoing embodiments, and will not be repeated here.

[0127] The aforementioned data processing method updates the data set file corresponding to the business process through a proxy process. The business process maps the updated target data set file to itself via memory mapping. At this point, the business process obtains the updated target data set file but does not access its memory. The target data set file does not actually occupy the business process's physical memory. After releasing the data from the original data set file in physical memory, the business process writes the data from the target data set file into its own physical memory. Based on the data processing method provided in this disclosure, the coexistence of the target data set file and the original target data set file in the business process's physical memory during data rotation can be avoided. This reduces memory consumption, prevents memory consumption spikes caused by the coexistence phenomenon, and thus ensures the availability and stability of the services corresponding to the process.

[0128] In one exemplary embodiment, such as Figure 6 As shown, in step S506, updating the data set file corresponding to the business process based on the target data set file can be achieved through the following steps:

[0129] In step 602, the target data set file is stored on the disk, and the first disk location of the target data set file is obtained;

[0130] In step 604, the location information in the linked file is updated to the first disk location, wherein the linked file is used to record the disk location of the data set file corresponding to the business process on the disk.

[0131] In this embodiment, after the agent process reads the target data set file, it can construct data from the target data set file, that is, store it on the disk according to a specified directory format, and obtain the first disk location of the target data set file. It can then update the link file based on this first disk location, changing the location information recorded in the link file from the second disk location of the original data set file to the first disk location. This allows the updated link file to point to the target data set file based on the first disk location. Consequently, the business process can obtain the first disk location of the target data set file based on the link file, perform memory mapping on the target data set file based on the first disk location to obtain the virtual memory address of the target data set file, and access the target data set file based on this virtual memory address to write the data in the target data set file into the physical memory of the business process.

[0132] According to the data processing method provided in this disclosure, the data set file used by the business process is updated and constructed through a proxy process. The business process and the proxy process communicate through a link file, so that the proxy process can obtain the updated target data set without the business process updating and constructing the data set file. That is, the target data set file does not occupy the memory space of the business process during the update and construction process. This can avoid the phenomenon that the data in the target data set file and the original target data set file coexist in the physical memory of the business process during data rotation, which can reduce memory consumption and avoid the occurrence of memory consumption spikes caused by the above coexistence phenomenon, thereby ensuring the availability and stability of the service corresponding to the process.

[0133] In one embodiment, a data processing system is provided, such as Figure 7 As shown, the data processing system includes a business process 702 and an agent process 704, wherein...

[0134] When agent process 704 detects an update to the data set file for the business process in the data set storage area, it retrieves the target data set file from the data set storage area and updates the corresponding data set file for the business process based on the target data set file.

[0135] When business process 702 determines that agent process 704 has updated the data set file corresponding to the business process, it performs memory mapping on the updated target data set file to obtain the virtual memory address of the target data set file.

[0136] After business process 702 releases the data from the original data set file from its physical memory, it writes the data from the target data set file into physical memory based on the virtual memory address in the target data set file.

[0137] In this embodiment of the disclosure, the proxy process 704 monitors the data set storage area. When the data set file used by the business process in the data set storage area is updated from the original data set file to the target data set file, the proxy process 704 detects that the data set file for the business process 702 in the data set storage area has been updated. Then, it can read the target data set file from the data set storage area and update the data set file corresponding to the business process according to the target data set file.

[0138] For example, after the agent process reads the target data set file, it can construct local data based on the target data set file and store the target data set file on the disk according to the specified directory format, thus obtaining the first disk location of the target data set file. After obtaining the first disk location of the target data set file, agent process 704 can update the second disk location recorded in the linked file to the first disk location. Business process 702 can monitor the linked file and obtain the update status of the data set file based on the update status of the linked file.

[0139] When business process 702 determines that agent process 704 is updating the data set file, it can read the first disk address of the target data set file from the linked file, perform memory mapping on the target data set file based on the first disk address, and obtain the virtual memory address of the target data set file. After completing the memory mapping, the data of the original data set file in the physical memory of business process 702 is released, and memory access operation is performed on the target data set file according to the virtual memory address of the target data set file to write the data in the target data set file into physical memory (the specific process can be referred to the relevant description in the foregoing embodiments, and will not be repeated here).

[0140] According to the data processing system provided in this disclosure, the data set file used by the business process is updated and data is constructed through a proxy process. The business process and the proxy process communicate through a link file, so that the business process can obtain the updated target data set through the proxy process without the proxy process updating and constructing the data set file. This can reduce the memory consumption of the business process and avoid the phenomenon that the data in the target data set file and the original target data set file coexist in the physical memory of the business process during data rotation. This can reduce memory consumption and avoid the occurrence of memory consumption spikes caused by the above coexistence phenomenon, thereby ensuring the availability and stability of the service corresponding to the process.

[0141] In one embodiment, the agent process 704 stores the target data set file on the disk. After obtaining the first disk location of the target data set file, it updates the location information in the linked file to the first disk location. The linked file is used to record the disk location of the data set file corresponding to the business process on the disk.

[0142] In one embodiment, the business process 702 listens to the linked file, and when it detects an update to the linked file, it obtains the first disk location of the updated target data set file on the disk from the linked file, and performs memory mapping on the target data set file based on the first disk location to obtain the virtual memory address of the target data set file.

[0143] In one embodiment, the business process 702 accesses the data in the target data set file based on the virtual memory address of the target data set file, and if the data to be accessed in the target data set file has not been written to physical memory, a page fault interrupt mechanism is used to write the data to be accessed into physical memory.

[0144] In one embodiment, after the business process 702 obtains the second disk location of the original data set file on the disk from the link file, it performs memory mapping on the original data set file according to the second disk location to obtain the virtual memory address of the original data set file.

[0145] Business process 702 accesses the data in the original data set file based on the virtual memory address of the original data set file, and if the data to be accessed in the original data set file has not been written to the physical memory, it uses a page fault interrupt mechanism to write the data to be accessed in the original data set file to the physical memory.

[0146] In this embodiment, the relevant operations of business process 702 and agent process 704 can be referred to the relevant descriptions in the foregoing embodiments, and will not be repeated here.

[0147] To enable those skilled in the art to better understand the embodiments of this disclosure, the embodiments of this disclosure are described below through specific examples.

[0148] Reference Figure 8 As shown, after reading the original data set file, the agent process can construct data locally based on the original data set file, and store the original data set file on the disk according to the specified directory format, thus obtaining the disk location 1 of the original data set file on the disk.

[0149] The agent process writes the link file based on disk location 1, and at this time the link file points to the original data set file based on disk location 1.

[0150] The business process obtains the disk location 1 of the original data set file through the link file. It then uses system calls such as open / shm_open and mmap to perform memory mapping on disk location 1, obtaining the virtual memory address corresponding to the original data set file. Based on this virtual memory address, it accesses the data in the original data set file, gradually writing it into the business process's physical memory through page faults.

[0151] Suppose that after a period of time, the agent process detects that the data set file used by the business process has been updated, then it obtains the updated target data set file and constructs the data on the local disk based on the target data set file, that is, it stores the target data set file on the disk according to the specified directory format, and obtains the disk location 2 of the target data set file on the disk.

[0152] The agent process updates the link file based on disk location 2, changing disk location 1 in the link file to disk location 2. At this point, the link file points to the target data set file based on disk location 2.

[0153] The business process monitors the link file. When it detects a change in the link file, it can read disk location 2 from the link file and use system calls such as open / shm_open and mmap to perform memory mapping on disk location 2 to obtain the virtual memory address corresponding to the target data set file. At this time, the business process does not perform memory access operations on the target data set file, so the target data set file does not consume physical memory for the business process.

[0154] After the business process completes the memory mapping of the target data set file, it first releases the memory mapping corresponding to the original data set file through the munmap system call. At the same time, it also releases the physical memory occupied by the data of the original data set file in the business process. If we do not consider other memory consumption of the business process, the physical memory occupied by the business process at this time will drop to almost zero.

[0155] After releasing the data from the original data set file, the business process can access the data in the target data set file based on the virtual memory address corresponding to the target data set file. Since the data in the target data set file on disk is not yet written to physical memory in the initial stage, page faults will be frequently triggered initially to write the data from the target data set file on disk to physical memory. This gradually consumes physical memory until all the data in the target data set file is written to physical memory, reaching a steady state similar to that before each update, thus completing the current data update operation.

[0156] When data rotation occurs subsequently, the aforementioned process can be repeated (when data rotation occurs subsequently, the data set file before the data rotation is the aforementioned original data set file, and the data set file after the data rotation is the aforementioned target data set file). That is, during the data rotation process, there will never be a situation of double memory consumption (data in the target data set file + data in the original data set file), which can greatly improve the stability and availability of the business process.

[0157] Reference Figure 9a and Figure 9b , Figure 9a The data rotation method adopted is as follows: the business process updates the data itself, writes the data from the target data set file to physical memory, and then releases the data from the original data set file. The consumption of physical memory, virtual memory, and shared memory for the business process is as follows: Figure 9a As shown; Figure 9b To perform data rotation using the data processing method provided in this disclosure, since the business process uses system calls such as mmap for data access after data updates and construction are performed through a proxy process in this embodiment, the business process does not need to perform data updates and construction itself. This is relatively... Figure 9a The data rotation method shown can greatly reduce memory consumption of business processes and avoid memory consumption spikes.

[0158] It should be understood that, although Figures 1-8 The steps in the flowchart are shown sequentially as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified herein, there is no strict order in which these steps are executed, and they can be performed in other orders. Figures 1-8 At least some of the steps in the process may include multiple steps or multiple stages. These steps or stages are not necessarily completed at the same time, but may be executed at different times. The execution order of these steps or stages is not necessarily sequential, but may be executed in turn or alternately with other steps or at least some of the steps or stages in other steps.

[0159] It is understood that the same / similar parts between the various embodiments of the methods described above in this specification can be referred to each other. Each embodiment focuses on the differences from other embodiments, and relevant parts can be referred to the description of other method embodiments.

[0160] Figure 10 This is a block diagram of a data processing apparatus according to an exemplary embodiment. (Refer to...) Figure 10 The device includes a first mapping unit 1002, a release unit 1004, and a first writing unit 1006.

[0161] The first mapping unit 1002 is configured to perform memory mapping on the updated target data set file to obtain the virtual memory address of the target data set file when the agent process is detected to be updating the data set file corresponding to the business process.

[0162] Release unit 1004 is configured to release data in the original data set file in the physical memory of the business process;

[0163] The first writing unit 1006 is configured to write data from the target data set file into the physical memory according to the virtual memory address of the target data set file.

[0164] The aforementioned data processing device updates the data set file corresponding to the business process through a proxy process. The business process maps the updated target data set file to itself via memory mapping. At this point, the business process obtains the updated target data set file but does not access the data in the target data set file; that is, the target data set file does not actually occupy the physical memory of the business process. After releasing the data in the original data set file from physical memory, the business process writes the data in the target data set file into its own physical memory. Based on the data processing device provided in this disclosure, the coexistence of the target data set file and the data in the original target data set file in the physical memory of the business process can be avoided during data rotation. This reduces memory consumption, prevents memory consumption spikes caused by the coexistence phenomenon, and thus ensures the availability and stability of the services corresponding to the process.

[0165] In one example embodiment, the first mapping unit 1002 may include:

[0166] The listening subunit is configured to listen to a linked file, which is used to record the disk location of the data set file corresponding to the business process on the disk.

[0167] The determination subunit is configured to, upon detecting an update to the linked file, determine an update to the data set file corresponding to the business process, and obtain the first disk location of the updated target data set file on the disk from the linked file.

[0168] The mapping subunit is configured to perform memory mapping on the target data set file based on the first disk location to obtain the virtual memory address of the target data set file.

[0169] In one example embodiment, the first writing unit 1004 may include:

[0170] The access subunit is configured to perform access to data in the target data set file based on the virtual memory address of the target data set file;

[0171] The write subunit is configured to write the data to be accessed into the physical memory using a page fault mechanism if the data to be accessed in the target data set file has not been written into the physical memory.

[0172] In one example embodiment, the data processing apparatus may further include:

[0173] The acquisition unit is configured to retrieve the second disk location of the original data set file on the disk from the linked file;

[0174] The second mapping unit is configured to perform memory mapping on the original data set file according to the second disk location to obtain the virtual memory address of the original data set file;

[0175] The access unit is configured to perform access to data in the original data set file based on the virtual memory address of the original data set file;

[0176] The second write unit is configured to write the data to be accessed in the original data set file to the physical memory using a page fault interrupt mechanism if the data to be accessed in the original data set file has not been written to the physical memory.

[0177] Figure 11 A block diagram of a data processing apparatus is shown according to an exemplary embodiment. (Refer to...) Figure 11 The device includes a listening unit 1102, a reading unit 1104, and an updating unit 1106.

[0178] The listening unit 1102 is configured to listen to the data set storage area.

[0179] The reading unit 1104 is configured to read a target data set file from the data set storage area when an update of the data set file for a business process is detected in the data set storage area.

[0180] The update unit 1106 is configured to update the data set file corresponding to the business process according to the target data set file, so that after the data set file is updated, the business process performs memory mapping on the target data set file, and after releasing the data in the original data set file in the physical memory of the business process, writes the data in the target data set file into the physical memory according to the virtual memory address of the target data set file obtained through the memory mapping.

[0181] The aforementioned data processing device updates the data set file corresponding to the business process through a proxy process. The business process maps the updated target data set file to itself via memory mapping. At this point, the business process obtains the updated target data set file but does not access its memory. The target data set file does not actually occupy the physical memory of the business process. After releasing the data from the original data set file in physical memory, the business process writes the data from the target data set file into its own physical memory. Based on the data processing device provided in this disclosure, the coexistence of the target data set file and the data from the original target data set file in the physical memory of the business process can be avoided during data rotation. This reduces memory consumption, prevents memory consumption spikes caused by the coexistence, and thus ensures the availability and stability of the services corresponding to the process.

[0182] In one example embodiment, the update unit 1106 described above may include:

[0183] The storage subunit is configured to perform the operation of storing the target data set file on a disk, thereby obtaining the first disk location of the target data set file;

[0184] The update subunit is configured to update the location information in the linked file to the first disk location, wherein the linked file is used to record the disk location of the data set file corresponding to the business process on the disk.

[0185] Regarding the apparatus in the above embodiments, the specific manner in which each module performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0186] Figure 12 This is a block diagram illustrating an electronic device 1200 for implementing a data processing method according to an exemplary embodiment. For example, the electronic device 1200 may be a mobile phone, computer, digital broadcasting terminal, messaging device, game console, tablet device, medical device, fitness equipment, personal digital assistant, etc.

[0187] Reference Figure 12 The electronic device 1200 may include one or more of the following components: processing component 1202, memory 1204, power supply component 1206, multimedia component 1208, audio component 1210, input / output (I / O) interface 1212, sensor component 1214, and communication component 1216.

[0188] Processing component 1202 typically controls the overall operation of electronic device 1200, such as operations associated with display, telephone calls, data communication, camera operation, and recording operations. Processing component 1202 may include one or more processors 1220 to execute instructions to perform all or part of the steps of the methods described above. Furthermore, processing component 1202 may include one or more modules to facilitate interaction between processing component 1202 and other components. For example, processing component 1202 may include a multimedia module to facilitate interaction between multimedia component 1208 and processing component 1202.

[0189] Memory 1204 is configured to store various types of data to support the operation of electronic device 1200. Examples of such data include instructions for any application or method operating on electronic device 1200, contact data, phonebook data, messages, pictures, videos, etc. Memory 1204 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk, optical disk, or graphene storage.

[0190] Power supply component 1206 provides power to various components of electronic device 1200. Power supply component 1206 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 1200.

[0191] Multimedia component 1208 includes a screen that provides an output interface between the electronic device 1200 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touchscreen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may sense not only the boundaries of the touch or swipe action but also the duration and pressure associated with the touch or swipe operation. In some embodiments, multimedia component 1208 includes a front-facing camera and / or a rear-facing camera. When the electronic device 1200 is in an operating mode, such as a shooting mode or a video mode, the front-facing camera and / or the rear-facing camera may receive external multimedia data. Each front-facing camera and rear-facing camera may be a fixed optical lens system or have focal length and optical zoom capabilities.

[0192] Audio component 1210 is configured to output and / or input audio signals. For example, audio component 1210 includes a microphone (MIC) configured to receive external audio signals when electronic device 1200 is in an operating mode, such as call mode, recording mode, and voice recognition mode. The received audio signals may be further stored in memory 1204 or transmitted via communication component 1216. In some embodiments, audio component 1210 also includes a speaker for outputting audio signals.

[0193] I / O interface 1212 provides an interface between processing component 1202 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to, home buttons, volume buttons, power buttons, and lock buttons.

[0194] Sensor assembly 1214 includes one or more sensors for providing state assessments of various aspects of electronic device 1200. For example, sensor assembly 1214 may detect the on / off state of electronic device 1200, the relative positioning of components such as the display and keypad of electronic device 1200, changes in position of electronic device 1200 or its components, the presence or absence of user contact with electronic device 1200, orientation or acceleration / deceleration of device 1200, and temperature changes of electronic device 1200. Sensor assembly 1214 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. Sensor assembly 1214 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, sensor assembly 1214 may also include an accelerometer, gyroscope, magnetometer, pressure sensor, or temperature sensor.

[0195] Communication component 1216 is configured to facilitate wired or wireless communication between electronic device 1200 and other devices. Electronic device 1200 can access wireless networks based on communication standards, such as WiFi, carrier networks (such as 2G, 3G, 4G, or 5G), or combinations thereof. In one exemplary embodiment, communication component 1216 receives broadcast signals or broadcast-related information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, communication component 1216 also includes a near-field communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on radio frequency identification (RFID) technology, Infrared Data Association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0196] In an exemplary embodiment, the electronic device 1200 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field-programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the methods described above.

[0197] In an exemplary embodiment, a computer-readable storage medium including instructions is also provided, such as a memory 1204 including instructions, which can be executed by a processor 1220 of an electronic device 1200 to perform the above-described method. For example, the computer-readable storage medium may be a ROM, random access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0198] In an exemplary embodiment, a computer program product is also provided, the computer program product including instructions that can be executed by a processor 1220 of an electronic device 1200 to perform the above-described method.

[0199] It should be noted that the above-mentioned apparatus, electronic equipment, computer-readable storage medium, computer program product, etc., may also include other implementation methods according to the description of the method embodiments. For specific implementation methods, please refer to the description of the relevant method embodiments, which will not be elaborated here.

[0200] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the claims.

[0201] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

Claims

1. A data processing method, characterized in that, Applied to business processes, the method includes: The linked file is monitored. If an update operation is detected in the linked file, it is determined that the agent process has updated the data set file corresponding to the business process. The updated target data set file is then memory-mapped to obtain the virtual memory address of the target data set file. The linked file is used to store the address of the data set file used by the business process. After the update, the linked file points to the target data set file through the disk location. Release the data from the original data set file in the physical memory of the business process; Based on the virtual memory address of the target data set file, the data in the target data set file is written into the physical memory.

2. The method according to claim 1, characterized in that, When an update to the data set file corresponding to the business process is detected by the agent process, memory mapping is performed on the updated target data set file to obtain the virtual memory address of the target data set file, including: Monitor the linked file, which is used to record the disk location of the data set file corresponding to the business process on the disk. If the update of the linked file is detected, it is determined that the data set file corresponding to the business process has been updated, and the first disk location of the updated target data set file on the disk is obtained from the linked file. Based on the first disk location, the target data set file is memory-mapped to obtain the virtual memory address of the target data set file.

3. The method according to claim 1 or 2, characterized in that, The step of writing data from the target data set file into the physical memory based on the virtual memory address of the target data set file includes: Access the data in the target data set file based on the virtual memory address of the target data set file; If the data to be accessed in the target data set file has not been written to the physical memory, a page fault mechanism is used to write the data to be accessed into the physical memory.

4. The method according to claim 1 or 2, characterized in that, Before performing memory mapping on the updated target data set file to obtain the virtual memory address of the target data set file when the agent process is detected updating the data set file corresponding to the business process, the method further includes: Obtain the second disk location of the original data set file from the linked file; Based on the second disk location, the original data set file is memory-mapped to obtain the virtual memory address of the original data set file; Access the data in the original data set file based on the virtual memory address of the original data set file; If the data to be accessed in the original data set file has not been written to the physical memory, a page fault interrupt mechanism is used to write the data to be accessed in the original data set file to the physical memory.

5. A data processing method, characterized in that, Applied to a proxy process, the method includes: Monitor the data collection storage area; Upon detecting an update to the data set file for a business process in the data set storage area, the target data set file is read from the data set storage area. The link file is updated according to the target data set file, so that after the link file is updated, the business process performs memory mapping on the target data set file, and after releasing the data in the original data set file in the physical memory of the business process, writes the data in the target data set file into the physical memory according to the virtual memory address of the target data set file obtained through the memory mapping. The link file is used to store the address of the data set file used by the business process, and after the update, the link file points to the target data set file through the disk location.

6. The method according to claim 5, characterized in that, The step of updating the data set file corresponding to the business process according to the target data set file includes: The target data set file is stored on a disk to obtain the first disk location of the target data set file; The location information in the linked file is updated to the first disk location, wherein the linked file is used to record the disk location of the data set file corresponding to the business process on the disk.

7. A data processing system, characterized in that, The system includes business processes and agent processes, wherein, When the agent process detects an update to the data set file for the business process in the data set storage area, it retrieves the target data set file from the data set storage area and updates the link file according to the target data set file. The link file stores the address of the data set file used by the business process. After the update, the link file points to the target data set file through the disk location. The business process monitors the linked file. If it detects that the linked file has been updated, it determines that the proxy process has updated the data set file corresponding to the business process. It then performs memory mapping on the updated target data set file to obtain the virtual memory address of the target data set file. After the business process releases the data from the original data set file from the physical memory of the business process, it writes the data from the target data set file into the physical memory according to the virtual memory address in the target data set file.

8. The system according to claim 7, characterized in that, The agent process stores the target data set file on the disk. After obtaining the first disk location of the target data set file, it updates the location information in the linked file to the first disk location. The linked file is used to record the disk location of the data set file corresponding to the business process on the disk.

9. The system according to claim 8, characterized in that, The business process monitors the linked file, and when it detects an update to the linked file, it obtains the first disk location of the updated target data set file on the disk from the linked file, and performs memory mapping on the target data set file based on the first disk location to obtain the virtual memory address of the target data set file.

10. The system according to any one of claims 7 to 9, characterized in that, The business process accesses the data in the target data set file based on the virtual memory address of the target data set file, and if the data to be accessed in the target data set file has not been written to the physical memory, a page fault interrupt mechanism is used to write the data to be accessed into the physical memory.

11. The system according to any one of claims 7 to 9, characterized in that, After obtaining the second disk location of the original data set file on the disk from the link file, the business process performs memory mapping on the original data set file according to the second disk location to obtain the virtual memory address of the original data set file. The business process accesses the data in the original data set file based on the virtual memory address of the original data set file, and if the data to be accessed in the original data set file has not been written to the physical memory, a page fault interrupt mechanism is used to write the data to be accessed in the original data set file to the physical memory.

12. A data processing apparatus, characterized in that, Applied to business processes, the device includes: The first mapping unit is configured to listen to the linked file. If an update operation is detected in the linked file, it determines that the agent process has updated the data set file corresponding to the business process. The updated target data set file is then memory-mapped to obtain the virtual memory address of the target data set file. The linked file is used to store the address of the data set file used by the business process. After the update, the linked file points to the target data set file through the disk location. The release unit is configured to release data from the original data set file in the physical memory of the business process; The first writing unit is configured to write data from the target data set file into the physical memory according to the virtual memory address of the target data set file.

13. The data processing apparatus according to claim 12, characterized in that, The first mapping unit includes: The listening subunit is configured to listen to a linked file, which is used to record the disk location of the data set file corresponding to the business process on the disk. The determination subunit is configured to, upon detecting an update to the linked file, determine an update to the data set file corresponding to the business process, and obtain the first disk location of the updated target data set file on the disk from the linked file. The mapping subunit is configured to perform memory mapping on the target data set file based on the first disk location to obtain the virtual memory address of the target data set file.

14. The data processing apparatus according to claim 12 or 13, characterized in that, The first writing unit includes: The access subunit is configured to perform access to data in the target data set file based on the virtual memory address of the target data set file; The write subunit is configured to write the data to be accessed into the physical memory using a page fault mechanism if the data to be accessed in the target data set file has not been written into the physical memory.

15. The data processing apparatus according to claim 12 or 13, characterized in that, The data processing device further includes: The acquisition unit is configured to retrieve the second disk location of the original data set file on the disk from the linked file; The second mapping unit is configured to perform memory mapping on the original data set file according to the second disk location to obtain the virtual memory address of the original data set file; The access unit is configured to perform access to data in the original data set file based on the virtual memory address of the original data set file; The second write unit is configured to write the data to be accessed in the original data set file to the physical memory using a page fault interrupt mechanism if the data to be accessed in the original data set file has not been written to the physical memory.

16. A data processing apparatus, characterized in that, Applied to a proxy process, the device includes: The listening unit is configured to listen to the data set storage area. The reading unit is configured to read the target data set file from the data set storage area when an update to the data set file for the business process is detected in the data set storage area. The update unit is configured to update the link file according to the target data set file, so that after the link file is updated, the business process performs memory mapping on the target data set file, and after releasing the data in the original data set file in the physical memory of the business process, writes the data in the target data set file into the physical memory according to the virtual memory address of the target data set file obtained through the memory mapping. The link file is used to store the address of the data set file used by the business process, and after the update, the link file points to the target data set file through the disk location.

17. The apparatus according to claim 16, characterized in that, The update unit includes: The storage subunit is configured to perform the operation of storing the target data set file on a disk, thereby obtaining the first disk location of the target data set file; The update subunit is configured to update the location information in the linked file to the first disk location, wherein the linked file is used to record the disk location of the data set file corresponding to the business process on the disk.

18. An electronic device, characterized in that, include: processor; Memory used to store the processor's executable instructions; The processor is configured to execute the instructions to implement the data processing method as described in any one of claims 1 to 6.

19. A computer-readable storage medium, characterized in that, When the instructions in the computer-readable storage medium are executed by the processor of the electronic device, the electronic device is able to perform the data processing method as described in any one of claims 1 to 6.

20. A computer program product, the computer program product comprising instructions, characterized in that, When the instruction is executed by the processor of the electronic device, the electronic device is able to perform the data processing method as described in any one of claims 1 to 6.

Images