Data processing method and device, computer equipment and storage medium

By combining data processing methods of single-layer and four-layer storage media in solid-state drives, aggregating small blocks randomly writes into large blocks in sequence, solving the problems of low life and poor performance caused by writing amplification of QLC solid-state drives, and improving the solid-state The service life and performance of the hard disk, and the system stability is ensured through health status monitoring and early warning.

CN119045729AActive Publication Date: 2024-11-29INSPUR SUZHOU INTELLIGENT TECH CO LTD

Patent Information

Application Number
CN202411073850.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-08-06
Publication Date
2024-11-29
Estimated Expiration
2044-08-06

AI Technical Summary

Technical Problem

As a storage medium, QLC solid-state drives with high write amplification, resulting in a lower service life, poor performance and high delay, which cannot meet users' needs for high-frequency rewritten.

Method used

By using single-layer storage media and four-layer storage media for data processing when the amount of data to be written is less than the preset threshold, the data is processed by aggregating small blocks of random write data into large blocks in order, reducing the frequency of garbage collection and improving the SSD The number of times you can erase and overall performance, and timely warning through health status monitoring to extend the service life.

Benefits of technology

It effectively reduces write amplification of solid-state drives, improves service life and performance, reduces memory dependence, expands application scenarios, and improves system stability and data security.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119045729A_ABST
    Figure CN119045729A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of data storage, and discloses a data processing method and device, computer equipment and a storage medium, the method comprises the following steps: obtaining a current data processing mode, if the data processing mode is that data processing is carried out by using a first storage medium and a second storage medium, determining that the data volume of to-be-written data is less than a preset data volume threshold, in response to the data writing request, obtaining to-be-written data; sending the to-be-written data to a first storage medium; performing aggregation processing on the to-be-written data to obtain a target to-be-written data block; based on a mapping relation table of a logic address and a physical address of preset to-be-written data, writing the target to-be-written data block into a first storage medium; based on the sequence of the physical addresses corresponding to the target to-be-written data blocks from small to large, the target to-be-written data blocks are written into the solid state disk adopting a second storage medium, the first storage medium is a single-layer storage unit, and the second storage medium is a four-layer storage unit. The service life of the solid state disk is prolonged.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of data storage technology, and in particular to a data processing method, device, computer equipment and storage medium. Background Art

[0002] With the rapid development of the information age, solid state drives (SSDs) have rapidly penetrated into various application scenarios with their high speed and high reliability, becoming the mainstay in the field of data storage.

[0003] In the related technology, the cost-effectiveness, storage capacity, performance and life of SSDs will vary depending on the storage medium. SSDs using quad-level cells (QLC) have become the preferred choice for large-capacity storage solutions due to their high storage density and relatively low cost.

[0004] However, for SSDs that only use QLC as the storage medium, the write amplification is high due to the properties of QLC itself, resulting in a shorter service life of the SSD. Summary of the invention

[0005] In view of this, the present invention provides a data processing method, apparatus, computer device and storage medium to solve the problem in the related art that due to the inherent properties of QLC, the write amplification is high, resulting in a short service life of the solid-state hard disk.

[0006] In a first aspect, the present invention provides a data processing method, the method comprising:

[0007] Get the current data processing mode;

[0008] In the case where the data processing mode is to use a first storage medium and a second storage medium to perform data processing, determining that the amount of data to be written is less than a preset data amount threshold, and obtaining the data to be written in response to a write data request, wherein the first storage medium is a single-layer storage unit and the second storage medium is a four-layer storage unit;

[0009] Sending the data to be written to the first storage medium;

[0010] Aggregating the data to be written in the first storage medium to obtain a target data block to be written;

[0011] Writing the target data block to be written into the first storage medium based on a preset mapping relationship table of the logical address and the physical address of the data to be written;

[0012] Based on the physical addresses corresponding to the target data blocks to be written in ascending order, the target data blocks to be written are written into a solid state hard disk using a second storage medium.

[0013] The data processing method provided in this embodiment uses the first storage medium and the second storage medium to process data when the amount of data to be written is less than the preset data amount threshold, sends the acquired data to be written to the first storage medium, performs aggregation processing, obtains the target data block to be written, and writes the target data block to be written in a sequential manner into the solid-state hard disk using the second storage medium. By introducing a single-layer storage unit with low latency characteristics into the solid-state hard disk using the second storage medium, the poor performance of the solid-state hard disk using the second storage medium is compensated, the performance latency of the solid-state hard disk using the second storage medium is reduced, and the overall performance of the solid-state hard disk is improved.

[0014] Furthermore, by integrating small blocks of random write data into large blocks of sequential write data for processing, the frequency of garbage collection is reduced, and the write amplification of the solid-state hard disk using the second storage medium is reduced to a certain extent, thereby increasing the service life of the solid-state hard disk.

[0015] In an optional implementation, the aggregating the data to be written in the first storage medium to obtain a target data block to be written includes:

[0016] Acquire multiple data to be written sent to the first storage medium in each preset time period according to the order in which the data to be written are sent to the first storage medium;

[0017] For any preset time period, based on the multiple data to be written sent to the first storage medium in the preset time period, determine the total amount of the multiple data to be written sent to the first storage medium in the preset time period;

[0018] Determining whether the total amount of data reaches the data amount requirement of the target data block to be written;

[0019] In the case where the total amount of data reaches the data amount requirement of the target data block to be written, determining the number of the target data blocks to be written to be aggregated and the remaining data to be written based on the total amount of data and the data amount requirement of the target data blocks to be written;

[0020] Based on the number of target data blocks to be written to be aggregated, aggregating the data to be aggregated among the plurality of data to be written to obtain the target data blocks to be written;

[0021] The time when the first data to be written in the remaining data to be written is sent to the first storage medium is used as the start time of the next preset time period;

[0022] When the total amount of data does not meet the data amount requirement of the target data block to be written, aggregating the multiple data to be written to obtain an aggregated data block;

[0023] Determining the amount of data to be supplemented based on the data amount requirement of the target data block to be written and the aggregated data block;

[0024] Based on the amount of data to be supplemented, the aggregated data block is padded to obtain the target data block to be written.

[0025] The data processing method provided in this embodiment reduces the frequency of garbage collection by integrating small blocks of random write data into large blocks of sequential write data for processing, reduces the write amplification of the solid-state hard disk using the second storage medium to a certain extent, increases the number of erasable times of the solid-state hard disk, and thereby increases the service life of the solid-state hard disk.

[0026] In an optional embodiment, the method further includes:

[0027] In a case where the data processing mode is to use the second storage medium to perform data processing, determining that the amount of data to be written is not less than a preset data amount threshold, and obtaining the data to be written in response to a data write request;

[0028] The data to be written is written into the solid state hard disk using the second storage medium.

[0029] The data processing method provided in this embodiment, when the amount of data to be written is not less than a preset data amount threshold, chooses to use the second storage medium for data processing, which can significantly speed up the data writing speed, especially in the scenario of large data volume transmission, can reduce user waiting time and improve system response efficiency.

[0030] In an optional embodiment, the method further includes:

[0031] Obtaining health status monitoring information of the solid state drive;

[0032] Based on the health status monitoring information of the solid state drive, the service life information of the solid state drive is determined.

[0033] The data processing method provided in this embodiment obtains the health status monitoring information of the solid-state hard disk and determines the service life information of the solid-state hard disk based on the health status monitoring information. The system can predict potential problems before the solid-state hard disk fails and take timely measures, thereby improving the stability of the entire storage system and data security.

[0034] In an optional implementation, determining the service life information of the solid state drive based on the health status monitoring information of the solid state drive includes:

[0035] When the health status monitoring information of the solid state hard disk indicates that the life usage rate of the solid state hard disk is less than a preset life usage threshold, determining that the service life of the solid state hard disk is normal;

[0036] When the health status monitoring information of the solid state drive indicates that the life usage rate of the solid state drive is not less than a preset life usage threshold, it is determined that the life of the solid state drive is abnormal.

[0037] The data processing method provided in this embodiment can automatically and timely identify solid-state hard disks whose life usage rate is not less than the preset life usage threshold by setting a preset life usage threshold, determine that the service life of the solid-state hard disk is abnormal, and issue an early warning of the abnormal service life of the solid-state hard disk, so that maintenance personnel can take measures before the solid-state hard disk fails, reducing the risk of data loss and system interruption.

[0038] In an optional embodiment, the method further includes:

[0039] In the case where the service life of the solid state drive is abnormal, determining the degree of abnormality of the service life of the solid state drive based on the first comparison table;

[0040] When the abnormal degree of the service life is the first abnormal level, an abnormal service life alarm of the solid state hard disk is issued by a static alarm mode;

[0041] When the abnormal degree of the service life is the second abnormal level, an abnormal service life alarm of the solid state hard disk is issued by a static and dynamic combined alarm method;

[0042] Among them, the first comparison table is a comparison table of the abnormal degree of service life and the life utilization rate, and the first abnormal level is lower than the second abnormal level.

[0043] The data processing method provided in this embodiment, by setting a first comparison table, divides the abnormal degree of the service life of the solid state drive into different levels, thereby realizing refined management of alarms. This method can take different degrees of response measures according to the abnormal degree of the service life of the solid state drive, which not only avoids waste of resources caused by overreaction, but also ensures that major issues can receive sufficient attention.

[0044] In an optional implementation, the step of providing a SSD abnormality alarm in a static alarm manner includes:

[0045] Popping up an alarm window on the operating system interface, and displaying abnormal service life information of the solid state drive in the alarm window to issue an abnormal service life alarm for the solid state drive;

[0046] The abnormal service life alarm of the solid state drive by combining static and dynamic alarm methods includes:

[0047] An alarm window pops up on the operating system interface, and displays abnormal service life information of the solid state drive in the alarm window. At the same time, a continuous sound signal is emitted to warn of abnormal service life of the solid state drive.

[0048] The data processing method provided in this embodiment adopts different degrees of response measures according to the abnormal degree of the service life of the solid-state hard disk. For higher-level abnormalities, a combination of static and dynamic alarm methods are used to issue alarms, thereby reducing the possibility of missing alarms and allowing maintenance personnel to take corresponding measures in the shortest time to effectively prevent data loss or service interruption.

[0049] In a second aspect, the present invention provides a data processing device, the device comprising:

[0050] A first acquisition module is used to acquire the current data processing mode;

[0051] A first determining module is used to determine that the amount of data to be written is less than a preset data amount threshold value when the data processing mode is to use the first storage medium and the second storage medium to process data, and obtain the data to be written in response to a write data request, wherein the first storage medium is a single-layer storage unit and the second storage medium is a four-layer storage unit;

[0052] A sending module, used for sending the data to be written to the first storage medium;

[0053] A second acquisition module, configured to aggregate the data to be written in the first storage medium to obtain a target data block to be written;

[0054] A first writing module, configured to write the target data block to be written into a first storage medium based on a preset mapping relationship table between a logical address and a physical address of the data to be written;

[0055] The second writing module is used to write the target data block to be written into a solid state hard disk using a second storage medium based on the physical addresses corresponding to the target data block to be written in ascending order.

[0056] In a third aspect, the present invention provides a computer device, comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing computer instructions, and the processor executing the data processing method of the first aspect or any corresponding embodiment thereof by executing the computer instructions.

[0057] In a fourth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to enable a computer to execute the data processing method of the first aspect or any corresponding embodiment thereof.

[0058] In a fifth aspect, the present invention provides a computer program product, comprising computer instructions for causing a computer to execute the data processing method of the first aspect or any corresponding embodiment thereof. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the specific embodiments of the present invention or the technical solutions in the related technologies, the drawings required for use in the specific embodiments or the related technical descriptions will be briefly introduced below. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0060] Figure 1 is a flow chart of a data processing method according to an embodiment of the present invention;

[0061] Figure 2 is a flow chart of another data processing method according to an embodiment of the present invention;

[0062] Figure 3 is a flow chart of another data processing method according to an embodiment of the present invention;

[0063] Figure 4 is a schematic diagram of performing data processing according to an embodiment of the present invention;

[0064] Figure 5 is a schematic diagram of a process for monitoring the service life of a solid state drive according to an embodiment of the present invention;

[0065] Figure 6 is a structural block diagram of a data processing device according to an embodiment of the present invention;

[0066] Figure 7 It is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION

[0067] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0068] With the rapid development of the information age, the requirements for data storage are getting higher and higher. With the rapid development of SSD industry technology, SSD has quickly penetrated into various application scenarios with its high speed and high reliability, becoming the mainstay in the field of data storage.

[0069] At present, there are SSDs with different storage media on the market, such as single-level cell (SLC), multi-level cell (MLC), trinary-level cell (TLC), quad-level cell (QLC), penta-level cell (PLC) and other storage media.

[0070] SSDs with different storage media vary greatly in terms of cost, capacity, performance, and service life, and their application scenarios are also different. As customer needs become more and more diverse, the demand for data storage is increasing, and larger capacity space is needed to store massive amounts of information. Based on the differences in the properties of the storage media themselves, SSDs using QLC have become the preferred choice in massive storage solutions due to their high storage density and relatively low cost.

[0071] During the design and manufacturing process of SSD, only QLC is used as the single storage medium, which can meet users' demand for large-capacity storage of hard disks.

[0072] However, SSDs that only use QLC as storage media have high write amplification due to the properties of QLC itself, resulting in poor performance, high latency, and a short service life of the SSD, which has certain limitations in actual application.

[0073] One of the characteristics of QLC is that it can be erased and written less frequently. SSDs designed with QLC as the storage medium alone cannot meet the user's high-frequency erase and write requirements for hard disks, and their service life is lower than that of other storage media. SSDs designed with QLC as the storage medium alone do not have additional data cache processing modules to support them, resulting in a high degree of reliance on internal memory by SSDs designed with QLC as the storage medium.

[0074] An embodiment of the present invention provides a data processing method, which uses a first storage medium and a second storage medium to perform data processing when the amount of data to be written is less than a preset data amount threshold, sends the acquired data to be written to the first storage medium, performs aggregation processing, obtains a target data block to be written, and writes the target data block to be written in a sequential manner into a solid-state hard disk using the second storage medium, so as to achieve the effect of introducing a single-layer storage unit with a low latency characteristic into the solid-state hard disk using the second storage medium, thereby compensating for the poor performance of the solid-state hard disk using the second storage medium, reducing the performance delay of the solid-state hard disk using the second storage medium, and improving the overall performance of the solid-state hard disk.

[0075] By integrating small blocks of random write data into large blocks of sequential write data for processing, the frequency of garbage collection is reduced, the write amplification of the solid-state hard disk using the second storage medium is reduced to a certain extent, the number of erasable times of the solid-state hard disk is increased, and the service life of the solid-state hard disk is increased.

[0076] According to an embodiment of the present invention, a data processing method embodiment is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.

[0077] In this embodiment, a data processing method is provided, which can be used in a mobile terminal, such as a server, a central processing unit, etc. Figure 1 is a flow chart of a data processing method according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:

[0078] Step S101, obtaining the current data processing mode.

[0079] In response to a selection operation by a user, a current data processing mode is determined.

[0080] It should be noted that the user selects the current data processing mode according to the amount of data to be written.

[0081] Step S102, when the data processing mode is to use the first storage medium and the second storage medium to perform data processing, determine that the amount of data to be written is less than a preset data amount threshold, and obtain the data to be written in response to a write data request.

[0082] The first storage medium is a single-layer storage unit, and the second storage medium is a four-layer storage unit.

[0083] The data to be written is data carried by the write data request. The data volume of the data to be written is less than a preset data volume threshold, and it is determined that the data to be written is a small block of random write data.

[0084] When the data to be written is small-block random write data, the data processing mode is to use SLC and QLC to perform data processing.

[0085] It should be noted that since writing data has a relatively large impact on the service life of the solid-state drive, while the operation of reading data has a very small impact on the service life of the solid-state drive, which can be almost ignored. Therefore, the data processing method of this embodiment mainly describes how to increase the service life of the solid-state drive by reducing the impact of writing data on the service life of the solid-state drive.

[0086] It should be further noted that the preset data volume threshold is determined by a technician. Exemplarily, the preset data volume threshold may be 128K. Generally, the data volume of small blocks of random write data is generally 1K, 2K, 4K, 8K, 16K, etc.

[0087] Step S103: sending the data to be written to the first storage medium.

[0088] After the data to be written is acquired, the data to be written is sent to the first storage medium.

[0089] Step S104: Aggregate the data to be written in the first storage medium to obtain a target data block to be written.

[0090] After the data to be written is sent to the first storage medium, the data to be written in the first storage medium is aggregated to obtain a target data block to be written, that is, small blocks of random write data are integrated and converted into large blocks of sequential write data for processing.

[0091] Step S105 : writing the target data block to be written into the first storage medium based on a preset mapping relationship table between the logical address and the physical address of the data to be written.

[0092] The mapping relationship table between the logical address and the physical address of the preset data to be written is set by the technician and is set in the first storage medium. It can be understood that the physical address in the first storage medium is allocated to each target data block to be written according to the order in which the target data blocks to be written are obtained, wherein the earlier the target data blocks to be written are generated, the smaller the physical address is allocated.

[0093] For any target data block to be written, the target data block to be written is aggregated by multiple data to be written, and the physical address of the target data block to be written is divided into the physical address corresponding to each data to be written according to the order in which the multiple data to be written that are aggregated into the target data block to be written are sent to the first storage medium. The earlier the order in which the data to be written is sent to the first storage medium, the smaller the corresponding physical address.

[0094] After the physical address of each data to be written is determined, target data blocks to be written corresponding to the multiple data to be written are written into the first storage medium.

[0095] Step S106 , writing the target data block to be written into a solid state hard disk using a second storage medium based on the physical addresses corresponding to the target data block to be written in ascending order.

[0096] It can be understood that after the data to be written is aggregated into target data blocks to be written and the target data blocks to be written are cached in the first storage medium, the target data blocks to be written are written into the solid state drive using the second storage medium in the order of the physical addresses corresponding to the target data blocks to be written in the first storage medium from small to large. This achieves the writing of the aggregated large blocks of target data blocks to be written into the solid state drive using the second storage medium in a sequential writing manner.

[0097] The data processing method provided in this embodiment uses the first storage medium and the second storage medium to process data when the amount of data to be written is less than the preset data amount threshold, sends the acquired data to be written to the first storage medium, performs aggregation processing, obtains the target data block to be written, and writes the target data block to be written in a sequential manner to the solid-state hard disk using the second storage medium. By introducing a single-layer storage unit with low latency characteristics into the solid-state hard disk using the second storage medium, the poor performance of the solid-state hard disk using the second storage medium is compensated, the performance latency of the solid-state hard disk using the second storage medium is reduced, the overall performance of the solid-state hard disk is improved, and the original QLC SSD design is retained, which has no impact on the customer's original QLC SSD.

[0098] Furthermore, by integrating small blocks of random write data into large blocks of sequential write data for processing, the frequency of garbage collection is reduced, and the write amplification of the solid-state hard disk using the second storage medium is reduced to a certain extent, thereby increasing the service life of the solid-state hard disk.

[0099] This embodiment introduces SLC storage media with high erasable times into QLC SSD, so that QLC SSD can increase the erasable times, and then greatly increase the service life of QLC SSD. And by introducing SLC storage media into QLC SSD, IO read and write data will be integrated, converted and cached through SLC, which can greatly reduce the use of internal memory by QLC SSD itself, reduce the dependence on memory, expand the actual application scenarios of QLC SSD, and enhance customer confidence in use.

[0100] In this embodiment, a data processing method is provided, which can be used in a mobile terminal, such as a server, a central processing unit, etc. Figure 2 is a flow chart of a data processing method according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:

[0101] Step S201, obtain the current data processing mode. For details, see Figure 1 Step S101 of the illustrated embodiment will not be described in detail here.

[0102] Step S202: when the data processing mode is to use the first storage medium and the second storage medium to process data, determine that the amount of data to be written is less than a preset data amount threshold, and obtain the data to be written in response to a write data request.

[0103] The first storage medium is a single-layer storage unit, and the second storage medium is a four-layer storage unit. Figure 1 Step S102 of the illustrated embodiment will not be described in detail here.

[0104] Step S203: Send the data to be written to the first storage medium. Figure 1 Step S103 of the illustrated embodiment will not be described in detail here.

[0105] Step S204: Aggregate the data to be written in the first storage medium to obtain a target data block to be written.

[0106] Specifically, the above step S204 includes:

[0107] Step S2041 , acquiring a plurality of data to be written sent to the first storage medium within each preset time period according to the order in which the data to be written are sent to the first storage medium.

[0108] After the data to be written is sent to the first storage medium, a plurality of data to be written sent to the first storage medium are acquired within each preset time period in the order in which the data to be written is sent to the first storage medium.

[0109] It should be noted that the duration of the preset time period is set by a technician. Exemplarily, the duration of the preset time period is 20 milliseconds (ms). The default start time of the first preset time period is the time when the first data to be written is sent to the first storage medium. It is understandable that the multiple data to be written acquired in the first preset time period include the first data to be written and other data to be written sent to the first storage medium within 20ms after the first data to be written is sent to the first storage medium.

[0110] Step S2042: for any preset time period, based on the multiple data to be written sent to the first storage medium in the preset time period, determine the total amount of the multiple data to be written sent to the first storage medium in the preset time period.

[0111] After acquiring the plurality of data to be written that are sent to the first storage medium within a preset time period, the data amounts corresponding to the plurality of data to be written are added together to obtain the total data amount of the plurality of data to be written.

[0112] Step S2043, determining whether the total amount of data reaches the data amount requirement of the target data block to be written.

[0113] The data volume requirement of the target data block to be written is set by a technician. For example, the data volume requirement of the target data block to be written is 128K. That is, the data volume of each target data block to be written is 128K.

[0114] After obtaining the total amount of data of the plurality of to-be-written data, it is determined whether the total amount of data reaches the data amount requirement of the target writing data block, so as to determine whether the data can be aggregated into the target to-be-written data block.

[0115] Step S2044, when the total amount of data reaches the data amount requirement of the target data blocks to be written, the number of target data blocks to be written to be aggregated and the remaining data to be written are determined based on the total amount of data and the data amount requirement of the target data blocks to be written.

[0116] The total amount of data reaches the data amount requirement of the target data block to be written, indicating that it can be aggregated into at least one target data block to be written. The quotient obtained by dividing the total amount of data by the data amount requirement of the target data block to be written is the number of target data blocks to be aggregated, that is, the number of target data blocks to be aggregated into which multiple data to be written can be aggregated.

[0117] The remainder obtained by dividing the total amount of data by the required amount of data of the target data block to be written is the total amount of data corresponding to the remaining data to be written. It can be understood that the remaining data to be written is determined according to the order in which the multiple data to be written are sent to the first storage medium and the total amount of data corresponding to the remaining data to be written. Among them, the order in which the data to be aggregated into the target data block to be written among the multiple data to be written are sent to the first storage medium is earlier than the order in which the remaining data to be written are sent to the first storage medium.

[0118] Step S2045 , based on the number of target data blocks to be written to be aggregated, aggregate the data to be aggregated among the plurality of data to be written to obtain a target data block to be written.

[0119] After the number of target data blocks to be aggregated is determined, the data to be aggregated in the plurality of data to be written are aggregated in the order in which the data to be aggregated are sent to the first storage medium to obtain the target data blocks to be written.

[0120] It can be understood that the number of the obtained target data blocks to be written is the same as the number of the target data blocks to be aggregated.

[0121] That is, within the preset time period, whenever the accumulated size of the data to be written received by the first storage medium reaches the data size requirement of the target data block to be written, the accumulated data to be written are aggregated to obtain the target data block to be written.

[0122] Step S2046: The time when the first data to be written among the remaining data to be written is sent to the first storage medium is used as the start time of the next preset time period.

[0123] After determining the remaining data to be written in the preset time period, the time when the first data to be written in the remaining data to be written is sent to the first storage medium is used as the start time of the next preset time period, and the step of aggregating the data to be written in the next preset time period is continued.

[0124] It should be noted that the first data to be written in the remaining data to be written is the data to be written that is sent to the first storage medium in the earliest order among the remaining data to be written.

[0125] Step S2047, when the total amount of data does not reach the data amount requirement of the target data block to be written, aggregating the multiple data to be written to obtain an aggregated data block.

[0126] Among them, if the total amount of data within the preset time period does not meet the data amount requirement of the target data block to be written, it means that the target data block to be written cannot be generated after the obtained multiple data to be written are aggregated, then the multiple data blocks to be written are first aggregated to obtain an aggregated data block.

[0127] Step S2048, determining the amount of data to be supplemented based on the data amount requirement of the target data block to be written and the aggregated data block.

[0128] The data volume required for the target data block to be written is subtracted from the data volume of the aggregated data block to obtain the data volume to be supplemented.

[0129] Step S2049: based on the amount of data to be supplemented, the aggregated data block is padded to obtain the target data block to be written.

[0130] After the amount of data to be supplemented is determined, the aggregated data block is padded using a preset value to obtain a target data block to be written. The preset value may be 0.

[0131] That is, the data amount of the aggregated data block is padded with zeros to meet the data amount requirement of the target data block to be written, so as to obtain the target data block to be written.

[0132] It is understandable that, in the case where the total amount of data does not reach the data amount requirement of the target data block to be written in the preset time period, the start time of the next preset time period is the end time of the preset time period.

[0133] Step S205: Write the target data block to be written into the first storage medium based on the preset mapping relationship table between the logical address and the physical address of the data to be written. Figure 1 Step S105 of the illustrated embodiment will not be described in detail here.

[0134] Step S206, based on the physical addresses corresponding to the target data blocks to be written in ascending order, write the target data blocks to be written into the solid state drive using the second storage medium. Figure 1 Step S106 of the illustrated embodiment will not be described in detail here.

[0135] The data processing method provided in this embodiment reduces the frequency of garbage collection by integrating small blocks of random write data into large blocks of sequential write data for processing, reduces the write amplification of the solid-state hard disk using the second storage medium to a certain extent, increases the number of erasable times of the solid-state hard disk, and thereby increases the service life of the solid-state hard disk.

[0136] In some optional implementations, the data processing method further includes:

[0137] Step a1: when the data processing mode is to use the second storage medium to process data, determine that the amount of data to be written is not less than a preset data amount threshold, and obtain the data to be written in response to a data write request.

[0138] If the amount of data to be written is not less than the preset data amount threshold, the second storage medium is used for data processing, and the data to be written is obtained in response to the data write request. That is to say, when the data to be written is a large block of data, the way to write it to the solid state drive is a sequential write method, and no aggregation processing is required.

[0139] Step a2, writing the data to be written into a solid state hard disk using a second storage medium.

[0140] After the data to be written is acquired, the data to be written is written into a solid state hard disk using a second storage medium.

[0141] The data processing method provided in this embodiment, when the amount of data to be written is not less than a preset data amount threshold, chooses to use the second storage medium for data processing, which can significantly speed up the data writing speed, especially in the scenario of large data volume transmission, can reduce user waiting time and improve system response efficiency.

[0142] In some optional implementations, the data processing method further includes:

[0143] Step b1, obtaining health status monitoring information of the solid state drive.

[0144] Among them, the background process monitors the smart attribute information in real time, including real-time monitoring of the Percentage Used (life usage rate) in the smart attribute information of the solid-state drive. The smart attribute information can be obtained through the nvme smart-log / dev / nvme* command. The smart attribute information is the health status monitoring information in this embodiment.

[0145] Smart attribute information refers to a series of Self-Monitoring, Analysis, and Reporting Technology (SMART) parameters in storage devices (especially hard disks and solid-state drives). Smart attribute information can be used to evaluate the health of solid-state drives and predict possible failures of solid-state drives.

[0146] Step b2: determining the service life information of the solid state drive based on the health status monitoring information of the solid state drive.

[0147] After the health status monitoring information of the solid state drive is obtained, the service life information of the solid state drive is determined according to the Percentage Used attribute information in the health status monitoring information.

[0148] The data processing method provided in this embodiment obtains the health status monitoring information of the solid-state hard disk and determines the service life information of the solid-state hard disk based on the health status monitoring information. The system can predict potential problems before the solid-state hard disk fails and take timely measures, thereby improving the stability of the entire storage system and data security.

[0149] In some optional implementations, the above step b2 includes:

[0150] Step b21, when the health status monitoring information of the solid state drive indicates that the life usage rate of the solid state drive is less than a preset life usage threshold, determining that the service life of the solid state drive is normal.

[0151] Among them, when the life usage rate attribute information in the health status monitoring information represents that the life usage rate of the solid state hard disk is less than a preset life usage threshold, it is determined that the service life of the solid state hard disk is normal.

[0152] It should be noted that the preset life use threshold is set by a technician. For example, the preset life use threshold may be 95%.

[0153] Step b22, when the health status monitoring information of the solid state drive indicates that the life usage rate of the solid state drive is not less than a preset life usage threshold, determining that the life usage of the solid state drive is abnormal.

[0154] When the life usage rate attribute information in the health status monitoring information indicates that the life usage rate of the solid-state drive is not less than a preset life usage threshold, it is determined that the service life of the solid-state drive is abnormal, and corresponding processing measures may need to be taken, such as replacing the solid-state drive.

[0155] The data processing method provided in this embodiment can automatically and timely identify solid-state hard disks whose life usage rate is not less than the preset life usage threshold by setting a preset life usage threshold, determine that the service life of the solid-state hard disk is abnormal, and issue an early warning of the abnormal service life of the solid-state hard disk, so that maintenance personnel can take measures before the solid-state hard disk fails, reducing the risk of data loss and system interruption.

[0156] In some optional implementations, the data processing method further includes:

[0157] Step c1, when the service life of the solid state drive is abnormal, determining the abnormal degree of the service life of the solid state drive based on a first comparison table.

[0158] The first comparison table is a comparison table of abnormal degree of service life and service life utilization rate. The first comparison table is set by a technician. According to the first comparison table, the abnormal degree of service life of the solid state drive can be further determined.

[0159] Step c2: when the abnormal degree of the service life is at the first abnormal level, an abnormal service life alarm of the solid state drive is issued by a static alarm method.

[0160] Step c3: when the abnormal degree of the service life is the second abnormal level, an abnormal service life alarm of the solid state drive is issued by combining static and dynamic alarm methods.

[0161] The first abnormality level is lower than the second abnormality level.

[0162] The data processing method provided in this embodiment can automatically and timely identify solid-state hard disks whose life usage rate is not less than the preset life usage threshold by setting a preset life usage threshold, determine that the service life of the solid-state hard disk is abnormal, and issue an early warning of the abnormal service life of the solid-state hard disk, so that maintenance personnel can take measures before the solid-state hard disk fails, reducing the risk of data loss and system interruption.

[0163] In some optional implementations, the above step c2 includes:

[0164] Step c21, pop up an alarm window on the operating system interface, and display abnormal service life information of the solid state drive in the alarm window to issue an abnormal service life alarm for the solid state drive.

[0165] The static alarm mode may also be to display an alarm icon and abnormal service life information of the solid state drive in the desktop notification area of ​​the operating system to issue an abnormal service life alarm for the solid state drive.

[0166] The above step c3 includes:

[0167] Step c31, pop up an alarm window on the operating system interface, and display abnormal service life information of the solid state drive in the alarm window. At the same time, emit a continuous sound signal to warn of abnormal service life of the solid state drive.

[0168] That is to say, the dynamic alarm method is to send out a continuous sound signal, which can be a continuous alarm sound or voice prompt to attract the user's attention and deal with the abnormal service life of the solid state drive in time.

[0169] It is understandable that the dynamic alarm method can also be to control the indicator light corresponding to the solid-state hard disk to flash red to prompt the user that the service life of the solid-state hard disk is abnormal.

[0170] The data processing method provided in this embodiment adopts different degrees of response measures according to the abnormal degree of the service life of the solid-state hard disk. For higher-level abnormalities, a combination of static and dynamic alarm methods are used to issue alarms, thereby reducing the possibility of missing alarms and allowing maintenance personnel to take corresponding measures in the shortest time to effectively prevent data loss or service interruption.

[0171] In some optional implementations, the above step c1 includes:

[0172] Step c11, when the life usage rate of the solid state drive is not less than a preset life usage threshold and less than a first life usage rate, determining that the abnormal degree of the life of the solid state drive is a first abnormal level.

[0173] Step c12: when the life usage rate of the solid state drive is not less than the first life usage rate and less than the second life usage rate, determine that the abnormal degree of the life of the solid state drive is the second abnormal level.

[0174] It should be noted that the first life usage rate is less than the second life usage rate, and the first life usage rate is greater than the preset life usage threshold.

[0175] The first life usage rate and the second life usage rate are set by technical personnel and are not specifically limited here.

[0176] The data processing method provided in this embodiment subdivides the abnormal degree of service life of the solid state drive by setting a preset service life threshold, a first service life utilization rate, and a second service life utilization rate. This refined evaluation can more accurately reflect the health status of the solid state drive and help users and technicians better understand the use and potential risks of the hard drive.

[0177] In some optional implementations, the data processing method further includes:

[0178] Step d1, recording the alarm information of each abnormal service life alarm of the solid state drive, so that the user can analyze based on the alarm information and determine the maintenance strategy of the solid state drive.

[0179] The warning information may include the time of the abnormal service life warning, the degree of abnormality, the warning method and other information.

[0180] Analyze the alarm information to discover potential trends and problems, such as whether certain models of SSDs are more likely to have abnormal service life, which can provide a basis for improving the quality of SSDs, optimizing usage and formulating maintenance strategies.

[0181] The data processing method provided in this embodiment enables users to fully understand the abnormal conditions of the solid-state drive by recording detailed alarm information. By analyzing information such as the alarm time, abnormality level, and alarm method, users can more accurately assess the health status and risk level of the solid-state drive, thereby formulating a more reasonable maintenance strategy.

[0182] In this embodiment, a data processing system is provided, which includes an IO read-write module, an SLC application selection module, an SLC, a performance aggregation conversion module and an SSD using QLC.

[0183] Figure 3 is a flow chart of a data processing method according to an embodiment of the present invention. Figure 3 As shown, the IO read / write module is used to generate IO read / write data during the normal operation of the SSD using QLC, and perform IO read / write operations on the SSD using QLC. This embodiment is described with data to be written.

[0184] The SLC application selection module is used to respond to the user's selection operation to determine the current data processing mode, that is, to determine whether the current data processing mode needs to be matched with the application of SLC. It should be noted that, in the case of SLC application selection, it is determined to be matched with the application of SLC, and the data processing mode is to use the first storage medium and the second storage medium for data processing; in the case of SLC application not being selected, it is determined not to be matched with the application of SLC, and the data processing mode is to use the second storage medium for data processing.

[0185] In the case of SLC application selection, SLC will be introduced between the IO read / write module and the SSD using QLC. The IO read / write data generated by the IO read / write module will be first transmitted to the SLC, that is, in response to the write data request, the data to be written is obtained and sent to the first storage medium.

[0186] It should be noted that when IO reads and writes data through the SLC, the technician will generate a data storage mapping table inside the SLC. The data storage mapping table is a mapping relationship table of the logical address and physical address of the preset data to be written.

[0187] The performance aggregation conversion module will be called during the process of sending the data to be written to the first storage medium, that is, during the data transmission process. The performance aggregation conversion module integrates, processes and converts the transmitted IO write data according to the data storage mapping table, and integrates and converts small blocks of random write data into large blocks of sequential write data for processing. In other words, the data to be written in the first storage medium are aggregated to obtain the target data block to be written; based on the preset mapping relationship table of the logical address and physical address of the data to be written, the target data block to be written is written to the first storage medium; based on the order of the physical addresses corresponding to the target data blocks to be written from small to large, the target data block to be written is written to the solid-state hard disk using the second storage medium.

[0188] The data processing strategy can be: setting the sequential write block size to 128K, that is, the data volume requirement of the target data block to be written is 128K. After the host writes the random small data block, that is, the data to be written, the performance aggregation conversion module will integrate and transmit the random small data blocks (including 1K, 2K, 4K, 8K, 16K, etc.). Within a certain period of time (such as 20ms), when the data block size of the random small data block accumulates to 128K, the 128K data blocks will be written sequentially to the NAND flash memory in a sequential write manner. Among them, the SSD using QLC uses NAND flash memory technology. If the data block size of the random small data block does not accumulate to 128K after the set time (such as 20ms), the data block size is automatically filled to 128K, and it is also written to NAND in 128K data block order. Similar to the detailed description of the aforementioned steps S204, step S205, and step S206, they will not be repeated here.

[0189] In order to make the data processing strategy clearer, a specific embodiment is described below. Figure 4 is a schematic diagram of data processing according to an embodiment of the present invention. Figure 4 In the example, a 4K small data block is aggregated into a 128K large data block. The small data block is the data to be written, and the large data block is the target data block to be written.

[0190] like Figure 4 As shown, the small data blocks are sent to the SLC, and the performance aggregation conversion module aggregates the small data blocks within a certain period of time to obtain large data blocks. Among them, if the size of the 4K data blocks accumulates to 128K within 20ms, the small data blocks are aggregated into 128K large data blocks and written to NAND sequentially. If the size of the 4K data blocks accumulates less than 128K within 20ms, the data block size is automatically padded to 128K, and is also written to NAND sequentially as 128K data blocks.

[0191] Data is written to the QLC storage medium layer in 128K data blocks in a sequential write mode, thereby improving the overall write performance of the QLC SSD, reducing write latency, and reducing the frequency of garbage collection, thereby reducing the write amplification of the QLC SSD and ultimately increasing the service life of the QLC SSD.

[0192] When the SLC application is not selected, the IO read and write data will be directly transferred to the QLC storage medium layer for processing.

[0193] The data processing system also includes a hard disk service life monitoring module, an abnormality alarm module and an abnormality notification module. Figure 5 FIG. 1 is a flow chart of monitoring the service life of a solid state drive according to an embodiment of the present invention. Figure 5As shown, the hard disk service life monitoring module is used to monitor the service life utilization rate in the smart attribute information of the solid state hard disk in real time, and determine whether the service life of the hard disk is normal according to the relationship between the monitored service life utilization rate and the preset service life utilization threshold. For details, please refer to the description of the above steps b21 and b22.

[0194] If the hard disk service life is abnormal, the abnormal alarm module will issue a hard disk abnormal alarm and notify the maintenance personnel of the hard disk abnormal result through the abnormal notification module.

[0195] The steps of the abnormal alarm module performing hard disk abnormal alarm are detailed in the detailed description of the aforementioned step c1, step c2 and step c3, which will not be repeated here.

[0196] The step of the abnormal notification module notifying the maintenance personnel of the hard disk abnormality result is detailed in the above-mentioned step c21 and step c31, which will not be repeated here.

[0197] The data processing system provided in this embodiment, by introducing the QLC+SLC data processing method, implants a data storage mapping table in the SLC, and converts and transmits IO data blocks. Through the performance aggregation conversion module, small blocks of random write data are aggregated into large blocks of sequential write data for writing. Storing the data storage mapping table in the SLC has great advantages. Its high performance and low latency in reading and writing can ensure that the read and write performance of IO is guaranteed while greatly reducing the use of memory. As a cache for IO data, SLC can improve the write performance of QLC and reduce write amplification, thereby increasing the service life of QLC SSD. QLC is mainly used for high-density data storage and can greatly increase the data storage density of a single node. The perfect combination of QLC+SLC not only meets the user's demand for high-capacity hard disks, but also reduces write performance latency, improves the write performance of hard disks, and greatly increases the service life of QLC SSDs.

[0198] This embodiment introduces a hard disk service life monitoring module, which can realize real-time monitoring of the service life of the hard disk and real-time monitoring of abnormal alarms, thereby greatly ensuring the normal operation of the business.

[0199] It should be noted that part of the QLC can also be virtualized into SLC mode for data processing to achieve the desired effect of improving the performance and service life of the QLC.

[0200] In the present embodiment, a data processing device is also provided, which is used to implement the above-mentioned embodiments and preferred implementation modes, and the descriptions that have been made will not be repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the devices described in the following embodiments are preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceived.

[0201] This embodiment provides a data processing device, such as Figure 6 As shown, including:

[0202] The first acquisition module 601 is used to acquire the current data processing mode.

[0203] The first determination module 602 is used to determine that the amount of data to be written is less than a preset data amount threshold when the data processing mode is to use the first storage medium and the second storage medium for data processing, and obtain the data to be written in response to a write data request, wherein the first storage medium is a single-layer storage unit and the second storage medium is a four-layer storage unit.

[0204] The sending module 603 is used to send the data to be written to the first storage medium.

[0205] The second acquisition module 604 is used to aggregate the data to be written in the first storage medium to obtain a target data block to be written.

[0206] The first writing module 605 is used to write the target data block to be written into the first storage medium based on a preset mapping relationship table between the logical address and the physical address of the data to be written.

[0207] The second writing module 606 is used to write the target data block to be written into a solid state hard disk using a second storage medium based on the physical addresses corresponding to the target data block to be written in ascending order.

[0208] In some optional implementations, the second acquisition module 604 includes:

[0209] The first acquisition unit is used to acquire a plurality of to-be-written data sent to the first storage medium within each preset time period according to the order in which the to-be-written data are sent to the first storage medium.

[0210] The first determining unit is used to determine, for any preset time period, a total amount of the multiple data to be written sent to the first storage medium within the preset time period based on the multiple data to be written sent to the first storage medium within the preset time period.

[0211] The judging unit is used to judge whether the total amount of data reaches the data amount requirement of the target data block to be written.

[0212] The second determining unit is used to determine the number of target data blocks to be written to be aggregated and the remaining data to be written based on the total amount of data and the data amount requirement of the target data blocks to be written when the total amount of data reaches the data amount requirement of the target data blocks to be written.

[0213] The second acquisition unit is used to aggregate the data to be aggregated among the multiple data to be written based on the number of target data blocks to be aggregated to obtain the target data blocks to be written.

[0214] The third determining unit is configured to use the time when the first data to be written in the remaining data to be written is sent to the first storage medium as the start time of the next preset time period.

[0215] The third acquisition unit is used to aggregate the multiple to-be-written data to obtain an aggregated data block when the total amount of data does not reach the data amount requirement of the target to-be-written data block.

[0216] The fourth determining unit is used to determine the amount of data to be supplemented based on the data amount requirement of the target data block to be written and the aggregated data block.

[0217] The fourth acquisition unit is used to perform padding processing on the aggregated data block based on the amount of data to be supplemented, so as to obtain a target data block to be written.

[0218] In some optional implementations, the data processing device further includes:

[0219] The third acquisition module is used to determine that the amount of data to be written is not less than a preset data amount threshold when the data processing mode is to use the second storage medium to process data, and to acquire the data to be written in response to a write data request.

[0220] The third writing module is used to write the data to be written into the solid state hard disk using the second storage medium.

[0221] In some optional implementations, the data processing device further includes:

[0222] The fourth acquisition module is used to obtain health status monitoring information of the solid state drive.

[0223] The second determination module is used to determine the service life information of the solid state drive based on the health status monitoring information of the solid state drive.

[0224] In some optional implementations, the second determining module includes:

[0225] The fifth determination unit is used to determine that the service life of the solid state drive is normal when the health status monitoring information of the solid state drive indicates that the service life utilization rate of the solid state drive is less than a preset service life utilization threshold.

[0226] The sixth determination unit is used to determine that the service life of the solid state drive is abnormal when the health status monitoring information of the solid state drive indicates that the service life utilization rate of the solid state drive is not less than a preset service life utilization threshold.

[0227] In some optional implementations, the data processing device further includes:

[0228] The third determination module is used to determine the abnormal degree of the service life of the solid state drive based on the first comparison table when the service life of the solid state drive is abnormal.

[0229] The first alarm module is used to issue an abnormal service life alarm of the solid state drive in a static alarm manner when the abnormal service life degree is a first abnormal level.

[0230] The second alarm module is used to issue an abnormal service life alarm for the solid state drive by combining static and dynamic alarm methods when the abnormal service life degree is a second abnormal level.

[0231] Among them, the first comparison table is a comparison table of the abnormal degree of service life and the life utilization rate, and the first abnormal level is lower than the second abnormal level.

[0232] In some optional implementations, the first alarm module includes:

[0233] The first alarm subunit is used to pop up an alarm window on the operating system interface and display abnormal service life information of the solid state hard disk in the alarm window to issue an abnormal service life alarm for the solid state hard disk.

[0234] The second alarm module includes:

[0235] The second alarm sub-unit is used to pop up an alarm window on the operating system interface, and display the abnormal service life information of the solid state hard disk in the alarm window, and at the same time, send out a continuous sound signal to warn of the abnormal service life of the solid state hard disk.

[0236] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.

[0237] The data processing device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.

[0238] The embodiment of the present invention also provides a computer device having the above Figure 6 The data processing device shown.

[0239] See also Figure 7 , Figure 7 is a schematic diagram of the structure of a computer device provided by an optional embodiment of the present invention, such as Figure 7As shown, the computer device includes: one or more processors 701, memory 702, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Each component utilizes different buses to communicate with each other, and can be installed on a common mainboard or installed in other ways as required. The processor can process the instructions executed in the computer device, including instructions stored in the memory or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides part of the necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 7 A processor 701 is taken as an example.

[0240] The processor 701 may be a central processing unit, a network processor or a combination thereof. The processor 701 may further include an integrated circuit. The integrated circuit may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable logic gate array, a general purpose array logic or any combination thereof.

[0241] The memory 702 stores instructions executable by at least one processor 701, so that the at least one processor 701 executes the method shown in the above embodiment.

[0242] The memory 702 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 702 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 702 may optionally include a memory remotely arranged relative to the processor 701, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0243] The memory 702 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 702 may also include a combination of the above types of memory.

[0244] The computer device also includes a communication interface 703, which is used for the computer device to communicate with other devices or a communication network.

[0245] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.

[0246] A part of the present invention may be applied as a computer program product, such as a computer program instruction, which, when executed by a computer, can call or provide the method and / or technical solution according to the present invention through the operation of the computer. Those skilled in the art should understand that the existence of the computer program instruction in a computer-readable medium includes, but is not limited to, a source file, an executable file, an installation package file, etc., and accordingly, the way in which the computer program instruction is executed by the computer includes, but is not limited to: the computer directly executes the instruction, or the computer compiles the instruction and then executes the corresponding compiled program, or the computer reads and executes the instruction, or the computer reads and installs the instruction and then executes the corresponding installed program. Here, the computer-readable medium may be any available computer-readable storage medium or communication medium accessible to the computer.

[0247] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.

Claims

1. A data processing method, characterized in that: The method comprises: Get the current data processing mode; In the case where the data processing mode is to use a first storage medium and a second storage medium to perform data processing, determining that the amount of data to be written is less than a preset data amount threshold, and obtaining the data to be written in response to a write data request, wherein the first storage medium is a single-layer storage unit and the second storage medium is a four-layer storage unit; Sending the data to be written to the first storage medium; Aggregating the data to be written in the first storage medium to obtain a target data block to be written; Writing the target data block to be written into the first storage medium based on a preset mapping relationship table of the logical address and the physical address of the data to be written; Based on the physical addresses corresponding to the target data blocks to be written in ascending order, the target data blocks to be written are written into a solid state hard disk using a second storage medium.

2. The method according to claim 1, characterized in that The step of performing aggregation processing on the data to be written in the first storage medium to obtain a target data block to be written includes: Acquire multiple data to be written sent to the first storage medium in each preset time period according to the order in which the data to be written are sent to the first storage medium; For any preset time period, based on the multiple data to be written sent to the first storage medium in the preset time period, determine the total amount of the multiple data to be written sent to the first storage medium in the preset time period; Determining whether the total amount of data reaches the data amount requirement of the target data block to be written; In the case where the total amount of data reaches the data amount requirement of the target data block to be written, determining the number of the target data blocks to be written to be aggregated and the remaining data to be written based on the total amount of data and the data amount requirement of the target data blocks to be written; Based on the number of target data blocks to be written to be aggregated, aggregating the data to be aggregated among the plurality of data to be written to obtain the target data blocks to be written; The time when the first data to be written in the remaining data to be written is sent to the first storage medium is used as the start time of the next preset time period; When the total amount of data does not meet the data amount requirement of the target data block to be written, aggregating the multiple data to be written to obtain an aggregated data block; Determining the amount of data to be supplemented based on the data amount requirement of the target data block to be written and the aggregated data block; Based on the amount of data to be supplemented, the aggregated data block is padded to obtain the target data block to be written.

3. The method according to claim 1, characterized in that The method further comprises: In a case where the data processing mode is to use the second storage medium to perform data processing, determining that the amount of data to be written is not less than a preset data amount threshold, and obtaining the data to be written in response to a data write request; The data to be written is written into the solid state hard disk using the second storage medium.

4. The method according to claim 1, characterized in that: The method further comprises: Obtaining health status monitoring information of the solid state drive; Based on the health status monitoring information of the solid state drive, the service life information of the solid state drive is determined.

5. The method according to claim 1, characterized in that The determining the service life information of the solid state drive based on the health status monitoring information of the solid state drive includes: When the health status monitoring information of the solid state hard disk indicates that the life usage rate of the solid state hard disk is less than a preset life usage threshold, determining that the service life of the solid state hard disk is normal; When the health status monitoring information of the solid state drive indicates that the life usage rate of the solid state drive is not less than a preset life usage threshold, it is determined that the life of the solid state drive is abnormal.

6. The method according to claim 1, characterized in that The method further comprises: In the case where the service life of the solid state drive is abnormal, determining the degree of abnormality of the service life of the solid state drive based on the first comparison table; When the abnormal degree of the service life is the first abnormal level, an abnormal service life alarm of the solid state hard disk is issued by a static alarm mode; When the abnormal degree of the service life is the second abnormal level, an abnormal service life alarm of the solid state hard disk is issued by a static and dynamic combined alarm method; Among them, the first comparison table is a comparison table of the abnormal degree of service life and the life utilization rate, and the first abnormal level is lower than the second abnormal level.

7. The method according to claim 6, characterized in that The method of performing a SSD abnormality alarm by a static alarm method includes: Popping up an alarm window on the operating system interface, and displaying abnormal service life information of the solid state drive in the alarm window to issue an abnormal service life alarm for the solid state drive; The abnormal service life alarm of the solid state drive by combining static and dynamic alarm methods includes: An alarm window pops up on the operating system interface, and displays abnormal service life information of the solid state drive in the alarm window. At the same time, a continuous sound signal is emitted to warn of abnormal service life of the solid state drive.

8. A data processing device, characterized in that: The device comprises: A first acquisition module is used to acquire the current data processing mode; A first determining module is used to determine that the amount of data to be written is less than a preset data amount threshold value when the data processing mode is to use the first storage medium and the second storage medium to process data, and obtain the data to be written in response to a write data request, wherein the first storage medium is a single-layer storage unit and the second storage medium is a four-layer storage unit; A sending module, used for sending the data to be written to the first storage medium; A second acquisition module, configured to aggregate the data to be written in the first storage medium to obtain a target data block to be written; A first writing module, configured to write the target data block to be written into a first storage medium based on a preset mapping relationship table between a logical address and a physical address of the data to be written; The second writing module is used to write the target data block to be written into a solid state hard disk using a second storage medium based on the physical addresses corresponding to the target data block to be written in ascending order.

9. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the data processing method according to any one of claims 1 to 7 by executing the computer instructions.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the data processing method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Solid state disk write-in method and device, computer equipment and storage medium

    CN109582227A

  • Small file processing method and system based on hierarchical storage, terminal and medium

    CN115309341A

  • Write I / O convergence method and device, storage equipment and storage medium

    CN116665727A

  • Storing page write attributes

    US20190278491A1

Cited By

  • Cooling method and device for hard disk of electronic equipment, electronic equipment and storage medium

    CN119937907A

  • Data storage method, distributed storage system, device, medium and product

    CN120540608A

  • Hierarchical storage method and device of data, storage medium and electronic equipment

    CN120743203A