A method, device, electronic device and storage medium for detecting memory leaks

Abstract

An embodiment of the present invention provides a memory leak detection method, apparatus, electronic device, and storage medium, which monitor native memory allocation functions called during the operation of a target process; during the process of the native memory allocation function allocating memory to be allocated, obtain the memory stack information corresponding to the memory to be allocated, where the memory stack information includes a call stack address list of memory allocation; according to the memory stack information, allocate a data memory area and a reserved memory area of a first preset length, where the data memory area is the memory area corresponding to the memory to be allocated, and the reserved memory area of the first preset length is a memory area reserved for storing the memory stack information; store the memory stack information in the reserved memory area; when a leaked address is detected, read the memory stack information in the reserved memory area corresponding to the leaked address. It can effectively improve the efficiency of memory leak detection and analysis.

Description

Technical Field

[0001] The present invention relates to the field of computer application technologies, and particularly to a method, device, electronic device, and storage medium for detecting memory leaks. Background Art

[0002] When performing Native (a computer function) memory leak monitoring and analysis, it is usually necessary to intercept memory allocation functions through hooks. Each time the program calls a memory allocation function, the obtained call stack information of the allocation function (hereinafter collectively referred to as memory stack information) is extracted, stored, and maintained, so that after detecting a memory leak address, the corresponding memory stack information position can be found through the detected address.

[0003] Currently, the commonly used memory stack storage and maintenance solution in the industry is through the method of a global Map (lookup table) and a global lock. Refer to Figure 1 , store the obtained memory stack information into the global Map and add a lock to ensure multi-thread safety. However, this method has obvious performance problems in a multi-threaded situation. Since different threads will compete for lock resources with each other, some threads and even the main thread will be briefly stalled. In this scenario, it may affect the normal use of the App (application program) by users, resulting in obvious operation lags, unsmooth sliding, and other negative effects, affecting the user experience, and it is impossible to perform memory leak monitoring and analysis without perception and with high efficiency online for the application program.

[0004] Therefore, how to improve the efficiency of memory leak monitoring and analysis is an important problem that needs to be solved for improving the overall monitoring performance of the application program. Summary of the Invention

[0005] The purpose of the embodiments of the present invention is to provide a method, device, electronic device, and storage medium for detecting memory leaks to achieve the purpose of improving the efficiency of memory leak monitoring and analysis. The specific technical solutions are as follows:

[0006] In a first aspect, an embodiment of the present application provides a method for detecting memory leaks, the method including:

[0007] Monitoring the native memory allocation functions called during the running of the target process;

[0008] During the process of the native memory allocation function allocating the memory to be allocated, obtaining the memory stack information corresponding to the memory to be allocated, where the memory stack information includes a call stack address list of the memory allocation;

[0009] According to the memory stack information, allocate a data memory area and a reserved memory area with a first preset length, where the data memory area is the memory area corresponding to the memory to be allocated, and the reserved memory area with the first preset length is the memory area reserved for storing the memory stack information;

[0010] Store the memory stack information in the reserved memory area;

[0011] When a leaked address is detected, read the memory stack information in the reserved memory area corresponding to the leaked address.

[0012] In a possible implementation manner, during the process of the native memory allocation function allocating the memory to be allocated, obtaining the memory stack information corresponding to the memory to be allocated includes:

[0013] When the memory stack information of the native memory allocation function is detected, extract the memory stack information in a preset hook function.

[0014] In a possible implementation manner, according to the memory stack information, allocating a data memory area and a reserved memory area with a first preset length includes:

[0015] Obtain a first preset length, and according to the memory stack information and the first preset length, call back the native memory allocation function to obtain a data memory area and a reserved memory area, where the reserved memory area is a storage area with a first preset length after the tail of the data memory area.

[0016] In a possible implementation manner, storing the memory stack information in the reserved memory area includes:

[0017] Reserve a reserved space with a second preset length in the reserved memory area, and store the memory stack information after the reserved space in the reserved memory area;

[0018] Write a preset feature value with a second preset length in the reserved space, and write a preset feature value with a second preset length after the memory stack information.

[0019] In a second aspect, an embodiment of the present application provides a memory leak detection device, and the device includes:

[0020] A target process monitoring module, configured to call a native memory allocation function during the process of monitoring the running of a target process;

[0021] A memory stack information acquisition module, configured to obtain the memory stack information corresponding to the memory to be allocated during the process of the native memory allocation function allocating the memory to be allocated, where the memory stack information includes a call stack address list of memory allocation;

[0022] A memory allocation module, configured to allocate a data memory area and a reserved memory area with a first preset length according to the memory stack information, where the data memory area is the memory area corresponding to the memory to be allocated, and the reserved memory area with the first preset length is the memory area reserved for storing the memory stack information;

[0023] A memory stack information storage module, configured to store the memory stack information in the reserved memory area;

[0024] A memory stack information reading module, configured to read the memory stack information in the reserved memory area corresponding to the leakage address when a leakage address is detected.

[0025] In a possible implementation manner, the memory stack information obtaining module is specifically configured to: when detecting the memory stack information of the native memory allocation function, extract the memory stack information in a preset hook function.

[0026] In a possible implementation manner, the memory allocation module is specifically configured to: obtain a first preset length, and according to the memory stack information and the first preset length, call back the native memory allocation function to obtain a data memory area and a reserved memory area, where the reserved memory area is a storage area with a first preset length after the tail of the data memory area.

[0027] In a possible implementation manner, the memory stack information storage module is specifically configured to: reserve a reserved space with a second preset length in the reserved memory area, and store the memory stack information after the reserved space in the reserved memory area;

[0028] Write a preset feature value with a second preset length in the reserved space, and write a preset feature value with a second preset length after the memory stack information.

[0029] In a third aspect, an embodiment of the present application provides an electronic device, including a processor, a communication interface, a memory, and a communication bus, where the processor, the communication interface, and the memory complete communication with each other through the communication bus;

[0030] The memory is used to store a computer program;

[0031] The processor is configured to implement any of the memory leakage detection methods in the present application when executing the program stored in the memory.

[0032] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, where a computer program is stored in the computer-readable storage medium, and when the computer program is executed by a processor, any of the memory leakage detection methods in the present application is implemented.

[0033] The memory leak detection method, device, electronic device, and storage medium provided by the embodiments of the present application monitor the native memory allocation functions called during the operation of the target process; during the process of the native memory allocation function allocating the memory to be allocated, obtain the memory stack information corresponding to the memory to be allocated, where the memory stack information includes a list of call stack addresses for memory allocation; according to the memory stack information, allocate a data memory area and a reserved memory area with a first preset length, where the data memory area is the memory area corresponding to the memory to be allocated, and the reserved memory area with the first preset length is the memory area reserved for storing the memory stack information; store the memory stack information in the reserved memory area; when a leaked address is detected, read the memory stack information in the reserved memory area corresponding to the leaked address. Compared with the prior art, it avoids the consumption of memory allocation resources caused by the global Map and the global lock, does not require additional memory allocation, stores the memory stack information in the reserved memory area, and can conveniently, quickly, and efficiently find the memory stack information during memory leak monitoring and analysis, thereby improving the efficiency of memory leak monitoring and analysis, and further enhancing the overall monitoring performance of the application program.

[0034] Of course, it is not necessary for any product or method implementing the present application to achieve all the above advantages simultaneously. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art.

[0036] Figure 1 A schematic diagram of a memory stack storage method in the related art;

[0037] Figure 2 A first schematic diagram of the memory leak detection method according to the embodiment of the present application;

[0038] Figure 3 A second schematic diagram of the memory leak detection method according to the embodiment of the present application;

[0039] Figure 4 A third schematic diagram of the memory leak detection method according to the embodiment of the present application;

[0040] Figure 5 A fourth schematic diagram of the memory leak detection method according to the embodiment of the present application;

[0041] Figure 6 A fifth schematic diagram of the memory leak detection method according to the embodiment of the present application;

[0042] Figure 7 A sixth schematic diagram of the memory leak detection method according to the embodiment of the present application;

[0043] Figure 8 This is the seventh schematic diagram of the memory leak detection method according to the embodiment of the present application;

[0044] Figure 9 This is a schematic diagram of a memory leak detection device according to the embodiment of the present application;

[0045] Figure 10 This is a schematic diagram of an electronic device according to the embodiment of the present application. Detailed implementation manners

[0046] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art based on the present application belong to the scope of protection of the present application.

[0047] In order to improve the efficiency of memory leak monitoring and analysis, the embodiment of the present application provides a memory leak detection method, which includes: monitoring the native memory allocation functions called during the running of the target process; during the process of the native memory allocation function allocating the memory to be allocated, obtaining the memory stack information corresponding to the memory to be allocated, where the memory stack information includes a call stack address list of memory allocation; according to the memory stack information, allocating a data memory area and a reserved memory area with a first preset length, where the data memory area is the memory area corresponding to the memory to be allocated, and the reserved memory area with the first preset length is the memory area reserved for storing the memory stack information; storing the memory stack information in the reserved memory area; when a leak address is detected, reading the memory stack information in the reserved memory area corresponding to the leak address.

[0048] In the embodiment of the present application, storing the memory stack information in the reserved memory area does not require additional memory allocation, and can conveniently, quickly and efficiently find the memory stack information, thereby achieving the improvement of the efficiency of memory leak monitoring and analysis.

[0049] The following is a specific description. Refer to Figure 2 , Figure 2 This is a schematic diagram of a memory leak detection method according to the embodiment of the present application, and the method includes:

[0050] S10. Monitoring the native memory allocation functions called during the running of the target process.

[0051] During the memory leak monitoring and analysis process, it is necessary to monitor the native memory allocation functions in each process.

[0052] S11. During the process of the native memory allocation function allocating the memory to be allocated, obtain the memory stack information corresponding to the memory to be allocated, where the memory stack information includes a list of call stack addresses for memory allocation.

[0053] The memory stack storage method in the embodiments of this application can be implemented by a computer. Among them, the memory stack information is a list of addresses that represents the call relationship of the program during runtime and is generated when the memory allocation function is called. The memory allocation function is used to apply for a continuous memory block area of a specified size. For example, malloc, calloc, realloc, etc. are not limited in this application. Each time the memory allocation function is called, a corresponding address list will be generated.

[0054] S12. According to the memory stack information, allocate a data memory area and a reserved memory area with a first preset length, where the data memory area is the memory area corresponding to the memory to be allocated, and the reserved memory area with the first preset length is the memory area reserved for storing the memory stack information.

[0055] The data memory area is the memory area applied for when the memory allocation function is called. For example, if thread A needs to apply for 1024 KB of memory space, it needs to call the memory allocation function to allocate a 1024 KB memory area, and this 1024 KB memory area is the data memory area. The reserved memory area with the first preset length is the memory area reserved for storing the corresponding memory stack information. The first preset length can be set according to the memory space size occupied by the memory stack information. For example, it can be 16 bytes or 18 bytes, etc.

[0056] S13. Store the memory stack information in the reserved memory area.

[0057] S14. When a leaked address is detected, read the memory stack information in the reserved memory area corresponding to the leaked address.

[0058] In one example, a memory leak monitoring and analysis tool can be used to detect the address where memory leak occurs, that is, the leaked address. The memory leak monitoring and analysis tool can be custom-selected according to the actual situation. For example, common Native memory leak monitoring and analysis tools such as mallocdebug or LeakTracer can be selected. The specific type of the memory leak monitoring and analysis tool is not limited in this application.

[0059] In one example, the leaked address includes the start address and length information of the memory area where the leak occurs. Determine the tail address of the memory area according to the start address and length information, and start searching from the tail of the leaked memory. The memory stack information can be read in the reserved memory area corresponding to the leaked address.

[0060] In the embodiments of the present application, the memory stack information is stored in a reserved memory area. Compared with the prior art, there is no need for a global Map and a global lock, so the memory resource consumption caused by maintaining the global Map and the global lock is avoided. Only the storage space for storing the memory stack information needs to be extended after the allocated data memory area, and there is no need to allocate extra memory for storing the memory stack information. When a leaked address is detected, the memory stack information is read in the reserved memory area corresponding to the leaked address. Since the reserved memory area is only a dozen bytes, the search speed is faster.

[0061] In a possible implementation manner, referring to Figure 3 , the above S11 includes:

[0062] S111, when the memory stack information of the native memory allocation function is detected, extract the memory stack information in a preset hook function.

[0063] The preset hook function can be a Hook function. The Hook function allows an application program to intercept and process system messages or specific events, and is used to capture memory stack information when the native memory allocation function is called.

[0064] The native memory allocation function is the underlying memory allocation function of the application program. In order to obtain the memory stack information when the underlying memory allocation function of the application program is called, a custom memory allocation function needs to be defined. For example, for the underlying memory allocation function malloc of the application program, a custom memory allocation function my_malloc is defined.

[0065] During the program running process, each time the native memory allocation function is called, the corresponding memory stack information can be obtained in the hook function.

[0066] In an example, referring to Figure 4 , each time the native memory allocation function malloc is called in the program, the memory stack information of the native memory allocation function malloc is routed to the custom memory allocation function my_malloc by using the hook function, and memory allocation is achieved by calling back the native memory allocation function malloc.

[0067] In the embodiments of the present application, extracting the memory stack information through the hook function provides a technical means for monitoring the native memory allocation function.

[0068] In a possible implementation manner, referring to Figure 5 , the above S12 includes:

[0069] S121. Obtain a first preset length. According to the memory stack information and the first preset length, call back the native memory allocation function to obtain a data memory area and a reserved memory area, where the reserved memory area is a storage area with a first preset length after the tail of the data memory area.

[0070] Each time the program calls the native memory allocation function, the applied data memory area can be obtained. The custom memory allocation function uses a hook function to obtain the corresponding memory stack information when calling the native memory allocation function. When the custom memory allocation function calls back the native memory allocation function interface, according to the size of the memory space occupied by the memory stack information, a storage space required for storing the memory stack information is reserved at the tail of the data memory area.

[0071] In the embodiment of the present application, a preset hook function is used to extract the memory stack information and store the memory stack information at the tail of the data memory area, without the need to allocate additional memory for storing the memory stack information, and it is also convenient to find the corresponding memory stack information.

[0072] In a possible implementation manner, see Figure 6 , the above S13 includes:

[0073] S131. Reserve a reserved space with a second preset length in the reserved memory area, and store the memory stack information after the reserved space in the reserved memory area.

[0074] S132. Write a preset feature value with a second preset length in the reserved space, and write a preset feature value with a second preset length after the memory stack information.

[0075] The preset feature value can be a magic feature value. The magic feature value is a custom feature value, and the feature value can be set to a feature value with a certain meaning or easy to identify. In one example, the magic feature value can be set to a two-byte number or letter, such as: 1024 or ab.

[0076] The reserved space with a second preset length is used to store the magic feature value. In one example, 4 bytes of memory space are reserved to store the magic feature value.

[0077] Reserve a reserved space for storing the magic feature value in the reserved memory area, store the memory stack information after the reserved space in the reserved memory area, write the magic feature value in the reserved space, and write the magic feature value after the memory stack information.

[0078] In one example, see Figure 7, store the obtained memory stack information in the reserved memory area, and add magic eigenvalues to the head and tail of the memory stack information.

[0079] In one example, refer to Figure 8 , store the memory stack information in the reserved memory area, add magic eigenvalues to the head and tail of the memory stack information, start searching from the tail of the leaked memory according to the leaked address, and lock the storage location of the memory stack information by searching for the magic eigenvalues, and extract the memory stack information.

[0080] In the embodiment of the present application, magic eigenvalues are added to the head and tail of the memory stack information. The magic eigenvalues can be used to conveniently and quickly determine the memory stack information in the reserved memory area corresponding to the leaked address. By adding magic eigenvalues, the storage location of the memory stack information can be quickly locked, and the memory stack information can be extracted. The location of the memory leak can be determined through the memory stack information. It can improve the efficiency of memory leak monitoring and analysis, so as to realize the online memory leak monitoring and analysis of the application program without perception and high efficiency.

[0081] The embodiment of the present application also provides a memory leak detection device, refer to Figure 9 , the device includes:

[0082] The target process monitoring module 30 is used to call the native memory allocation function during the monitoring of the target process running;

[0083] The memory stack information acquisition module 31 is used to acquire the memory stack information corresponding to the to-be-allocated memory during the process of the native memory allocation function allocating the to-be-allocated memory, where the memory stack information includes a call stack address list of the memory allocation;

[0084] The memory allocation module 32 is used to allocate a data memory area and a reserved memory area with a first preset length according to the memory stack information, where the data memory area is the memory area corresponding to the to-be-allocated memory, and the reserved memory area with the first preset length is the memory area reserved for storing the memory stack information;

[0085] The memory stack information storage module 33 is used to store the memory stack information in the reserved memory area;

[0086] The memory stack information reading module 34 is used to read the memory stack information in the reserved memory area corresponding to the leaked address when a leaked address is detected.

[0087] In a possible implementation manner, the memory stack information acquisition module is specifically used for: when detecting the memory stack information of the native memory allocation function, extracting the memory stack information in a preset hook function.

[0088] In a possible implementation manner, the memory allocation module is specifically configured to: obtain a first preset length, and according to the memory stack information and the first preset length, call back the native memory allocation function to obtain a data memory area and a reserved memory area, where the reserved memory area is a storage area with a first preset length after the tail of the data memory area.

[0089] In a possible implementation manner, the memory stack information storage module is specifically configured to: reserve a reserved space with a second preset length in the reserved memory area, and store the memory stack information after the reserved space in the reserved memory area;

[0090] Write a preset feature value with a second preset length in the reserved space, and write a preset feature value with a second preset length after the memory stack information.

[0091] An embodiment of the present invention further provides an electronic device, as Figure 10 shown, including a processor 51, a communication interface 52, a memory 53, and a communication bus 54. Among them, the processor 51, the communication interface 52, and the memory 53 complete communication with each other through the communication bus 54.

[0092] The memory 53 is used to store a computer program;

[0093] The processor 51 is configured to implement the method described in any one of the above embodiments when executing the program stored in the memory 53.

[0094] The communication bus mentioned in the above terminal may be a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus, etc. This communication bus can be divided into an address bus, a data bus, a control bus, etc. For the sake of convenience of representation, only a thick line is used in the figure, but it does not mean that there is only one bus or one type of bus.

[0095] The communication interface is used for communication between the above terminal and other devices.

[0096] The memory may include a Random Access Memory (RAM), or may also include a non-volatile memory, such as at least one disk memory. Optionally, the memory may also be at least one storage device located far from the foregoing processor.

[0097] The above-mentioned processor may be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it may also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

[0098] In another embodiment provided by the present invention, there is also provided a computer-readable storage medium, in which a computer program is stored, and when the computer program is executed by a processor, the method described in any one of the above embodiments is implemented.

[0099] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the processes or functions described in the embodiments of the present invention are generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center in a wired manner (such as coaxial cable, optical fiber, Digital Subscriber Line (DSL)) or a wireless manner (such as infrared, wireless, microwave, etc.). The computer-readable storage medium may be any available medium that can be accessed by a computer, or a data storage device such as a server or data center that includes one or more integrated available media. The available medium may be a magnetic medium (for example, a floppy disk, a hard disk, a magnetic tape), an optical medium (for example, a DVD), or a semiconductor medium (for example, a Solid State Disk (SSD)).

[0100] It should be noted that in this text, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any actual relationship or order between these entities or operations. Moreover, the term "comprising", "including" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device comprising a series of elements not only includes those elements, but also includes other elements not expressly listed, or further includes elements inherent to such process, method, article or device. Without further limitation, an element defined by the statement "comprising a..." does not exclude the existence of additional identical elements in the process, method, article or device comprising the said element.

[0101] Each embodiment in this specification is described in a related manner. For the same or similar parts among the embodiments, reference can be made to each other. Each embodiment focuses on the differences from other embodiments. In particular, for the embodiments of the device, electronic device, and storage medium, since they are basically similar to the method embodiments, the description is relatively simple, and the relevant parts can refer to the partial description of the method embodiments.

[0102] The above description is only a preferred embodiment of the present invention and is not intended to limit the protection scope of the present invention. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention are included within the protection scope of the present invention.

Claims

1. A method for detecting memory leaks, characterized in that, the method includes: monitoring the native memory allocation functions called during the operation of the target process; when detecting the memory stack information of the native memory allocation function, extracting the memory stack information in a preset hook function, where the memory stack information includes a list of call stack addresses for memory allocation; obtaining a first preset length, and according to the memory stack information and the first preset length, calling back the native memory allocation function to obtain a data memory area and a reserved memory area, where the reserved memory area is a storage area of the first preset length after the tail of the data memory area, the data memory area is the memory area corresponding to the memory to be allocated, and the reserved memory area of the first preset length is the memory area reserved for storing the memory stack information; storing the memory stack information in the reserved memory area; when detecting a leaked address, reading the memory stack information in the reserved memory area corresponding to the leaked address.

2. The method according to claim 1, characterized in that, storing the memory stack information in the reserved memory area includes: reserving a reserved space of a second preset length in the reserved memory area, and storing the memory stack information after the reserved space in the reserved memory area; writing a preset feature value of the second preset length in the reserved space, and writing a preset feature value of the second preset length after the memory stack information.

3. A device for detecting memory leaks, characterized in that, the device includes: a target process monitoring module for monitoring the native memory allocation functions called during the operation of the target process; a memory stack information obtaining module for extracting the memory stack information in a preset hook function when detecting the memory stack information of the native memory allocation function, where the memory stack information includes a list of call stack addresses for memory allocation; a memory allocation module for obtaining a first preset length, and according to the memory stack information and the first preset length, calling back the native memory allocation function to obtain a data memory area and a reserved memory area, where the reserved memory area is a storage area of the first preset length after the tail of the data memory area, the data memory area is the memory area corresponding to the memory to be allocated, and the reserved memory area of the first preset length is the memory area reserved for storing the memory stack information; a memory stack information storage module for storing the memory stack information in the reserved memory area; a memory stack information reading module for reading the memory stack information in the reserved memory area corresponding to the leaked address when detecting a leaked address.

4. The device according to claim 3, characterized in that, the memory stack information storage module is specifically used for: reserving a reserved space of a second preset length in the reserved memory area, and storing the memory stack information after the reserved space in the reserved memory area; writing a preset feature value of the second preset length in the reserved space, and writing a preset feature value of the second preset length after the memory stack information.

5. An electronic device, characterized in that, It includes a processor, a communication interface, a memory, and a communication bus. Among them, the processor, the communication interface, and the memory complete mutual communication through the communication bus; The memory is used to store computer programs; The processor is used to implement the memory leak detection method according to any one of claims 1-2 when executing the programs stored on the memory.

6. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, it implements the memory leak detection method according to any one of claims 1-2.

Images