Storage device control method, device, storage server, and computer device
By using the combination of intelligent control module and hard disk in the data storage device, the data flow channel is allocated and compressed and stored, the problems of low data storage capacity and high power consumption in the prior art are solved, and more efficient data storage and reduced device power consumption are achieved.
Patent Information
- Application Number
- CN202411709324.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-27
- Publication Date
- 2025-06-13
- Estimated Expiration
- 2044-11-27
AI Technical Summary
When the prior art deals with the pressure of video data storage, it is difficult to effectively improve data storage capabilities. At the same time, the equipment consumes a high power, resulting in heat dissipation problems.
By introducing a plurality of intelligent control modules into the data storage device, each module is connected to at least one hard disk, and obtains data flow channel and hard disk status information in response to storage instructions of the upper computer, and allocates the data flow channel based on these information, so that the intelligent control module receives stream data through the data flow channel and performs compressed storage.
It achieves the effect of improving data storage capabilities and reducing device power consumption, avoiding the overheating problem caused by centralized processing of CPU computing modules, and uses intelligent compression algorithms to store more video data on the hard disk.
Smart Images

Figure CN119201477B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of data compression, and particularly to a storage device control method, device, storage server, and computer device. Background Art
[0002] With the rise of the self-media era, due to the increase in intelligent devices, the improvement of video resolution, and the extension of the user storage cycle requirements, etc., the storage pressure of the server on video data is increasing.
[0003] Nowadays, in order to cope with the storage pressure, it is usually achieved by expanding the server storage space or upgrading the CPU computing module. However, expanding the storage space is difficult to cope with the explosive growth of storage requirements, and upgrading the CPU computing module will simultaneously increase the power consumption, resulting in abnormal heat dissipation.
[0004] It can be seen that there are still problems of low data storage capacity and high device power consumption in the current data storage field. Summary of the Invention
[0005] Based on this, in view of the above technical problems, it is necessary to provide a storage device control method, device, storage server, and computer device that can improve the data storage capacity and reduce the device power consumption.
[0006] In a first aspect, the present application provides a storage device control method, which is applied to a data storage device. The data storage device includes a plurality of intelligent control modules, and each intelligent control module is respectively connected to at least one hard disk. The storage device control method includes:
[0007] In response to a storage instruction from a host computer, obtain at least one data stream channel corresponding to the storage instruction, as well as the hard disk status information and module performance information corresponding to each intelligent control module;
[0008] Based on the hard disk status information and module performance information, allocate the corresponding at least one data stream channel to each intelligent control module, so that the intelligent control module receives the stream data through the data stream channel and compresses and stores the stream data in the hard disk.
[0009] In one embodiment, the hard disk status information includes at least one of the number of disk positions, hard disk slots, and hard disk capacity; the allocating the corresponding at least one data stream channel to each intelligent control module based on the hard disk status information and module performance information includes:
[0010] Based on at least one of the number of disk positions, the hard disk slots, and the hard disk capacity, determine the first processable channel threshold of each intelligent control module;
[0011] Based on the first processable channel threshold and the module performance information, allocate at least one corresponding data stream channel to each of the intelligent control modules.
[0012] In one embodiment, the module performance information includes data access capability and / or data compression capability; the step of allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk state information and the module performance information includes:
[0013] Based on the data access capability and / or the data compression capability, determine the second processable channel threshold for each intelligent control module;
[0014] Based on the hard disk state information and the second processable channel threshold, allocate at least one corresponding data stream channel to each of the intelligent control modules.
[0015] In one embodiment, the step of allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk state information and the module performance information further includes:
[0016] Obtain the working state of each intelligent control module;
[0017] Based on the hard disk state information and the module performance information, allocate at least one corresponding data stream channel to each intelligent control module with a normal working state.
[0018] In one embodiment, the storage device control method further includes:
[0019] In response to a reading instruction from the host computer, generate a stream data acquisition instruction;
[0020] Send the stream data acquisition instruction to the intelligent control module corresponding to the reading instruction;
[0021] Receive the stream data sent by the intelligent control module;
[0022] Forward the stream data to the host computer.
[0023] In a second aspect, the present application provides a data storage device, which includes a processor management module and a plurality of intelligent control modules, wherein:
[0024] The processor management module is respectively connected to the plurality of intelligent control modules; each intelligent control module is respectively connected to at least one hard disk;
[0025] The processor management module is configured to, in response to a storage instruction from a host computer, send information acquisition instructions to each of the intelligent control modules; acquire at least one data stream channel corresponding to the storage instruction, and receive the hard disk status information and module performance information corresponding to each intelligent control module; and based on the hard disk status information and the module performance information, allocate corresponding at least one data stream channel to each of the intelligent control modules.
[0026] The intelligent control module is configured to, based on the information acquisition instruction, send the hard disk status information and the module performance information to the processor management module; receive stream data through the data stream channel allocated by the processor management module, and compress and store the stream data in the hard disk.
[0027] In one embodiment, the data storage device further includes a network switching module. The processor management module is connected to a plurality of the intelligent control modules through the network switching module, and the network switching module is further connected to a plurality of data stream channels.
[0028] The processor management module is further configured to generate a channel allocation instruction based on the hard disk status information and the module performance information.
[0029] The network switching module is configured to allocate corresponding at least one data stream channel to each of the intelligent control modules based on the channel allocation instruction.
[0030] In one embodiment, the hard disk status information includes at least one of the number of disk positions, hard disk slots, and hard disk capacity; the processor management module is further configured to:
[0031] Determine a first processable channel threshold for each intelligent control module based on at least one of the number of disk positions, the hard disk slots, and the hard disk capacity.
[0032] Allocate corresponding at least one data stream channel to each of the intelligent control modules based on the first processable channel threshold and the module performance information.
[0033] In one embodiment, the module performance information includes data access capability and / or data compression capability; the processor management module is further configured to:
[0034] Determine a second processable channel threshold for each intelligent control module based on the data access capability and / or the data compression capability.
[0035] Allocate corresponding at least one data stream channel to each of the intelligent control modules based on the hard disk status information and the second processable channel threshold.
[0036] In one embodiment, the processor management module is further configured to:
[0037] Obtain the working status of each of the intelligent control modules;
[0038] Based on the hard disk status information and module performance information, allocate at least one corresponding data stream channel to each of the intelligent control modules with normal working status.
[0039] In one embodiment,
[0040] The processor management module is further configured to: in response to a read instruction from a host computer, generate a stream data acquisition instruction; send the stream data acquisition instruction to the intelligent control module corresponding to the read instruction; receive the stream data sent by the intelligent control module; forward the stream data to the host computer;
[0041] The intelligent control module is further configured to: in response to the stream data acquisition instruction, send the stream data corresponding to the stream data acquisition instruction in the hard disk to the processor management module.
[0042] In one embodiment, the intelligent control module is connected to the hard disk through an SATA bus, and the intelligent control module is further configured to:
[0043] Perform data pulling through the data stream channel allocated by the processor management module to obtain stream data;
[0044] Decode, intelligently compress, and encode the stream data in sequence to obtain compressed stream data;
[0045] Write the compressed stream data into the hard disk.
[0046] In a third aspect, the present application provides a computer device, including a memory and a processor, where the memory stores a computer program, and when the processor executes the computer program, the above-mentioned method is implemented.
[0047] In a fourth aspect, the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed by a processor, the above-mentioned method is implemented.
[0048] The above storage device control method, device, storage server, and computer device obtain at least one data stream channel corresponding to the storage instruction, as well as the hard disk status information and module performance information corresponding to each intelligent control module in response to a storage instruction from a host computer; based on the hard disk status information and module performance information, allocate the corresponding at least one data stream channel to each intelligent control module, so that the intelligent control module receives the stream data through the data stream channel and compresses and stores the stream data in the hard disk. It is a decentralized method that allocates the corresponding data stream channels to each intelligent control module according to the data that each intelligent control module can process. The intelligent control module independently processes the stream data in the accessed data stream channel, which can avoid the overheating problem caused by centralized processing of the CPU computing module. Through the compression algorithm of the intelligent control module, more video data can be stored in the same-capacity hard disk, thus achieving the effects of improving data storage capacity and reducing device power consumption. BRIEF DESCRIPTION OF THE DRAWINGS
[0049] Figure 1 FIG. is an application environment diagram of the storage device control method in an embodiment;
[0050] Figure 2 FIG. is a schematic flowchart of the storage device control method in an embodiment;
[0051] Figure 3 FIG. is a structural block diagram of a data storage device in an embodiment;
[0052] Figure 4 FIG. is a structural block diagram of a data storage device in another embodiment;
[0053] Figure 5 FIG. is a structural block diagram of a storage server in an embodiment;
[0054] Figure 6 FIG. is a schematic structural diagram of a hard disk enclosure in an embodiment;
[0055] Figure 7 FIG. is an internal structural diagram of a computer device in an embodiment. DETAILED DESCRIPTION OF THE EMBODIMENTS
[0056] In order to make the objectives, technical solutions, and advantages of the present application clearer, the present application will be further described in detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0057] The storage device control method provided by the embodiments of the present application can be applied to, for example Figure 1In the application environment shown. Among them, the terminal 102 is communicatively connected to the host computer 104 and multiple intelligent control modules 200 through a network. The terminal 102 responds to a storage instruction from the host computer, obtains at least one data stream channel corresponding to the storage instruction, as well as the hard disk status information and module performance information corresponding to each intelligent control module; based on the hard disk status information and module performance information, allocates the corresponding at least one data stream channel to each of the intelligent control modules, so that the intelligent control module receives the stream data through the data stream channel and compresses and stores the stream data in the hard disk. Among them, the terminal 102 can be but is not limited to various personal computers, laptop computers, smart phones, tablet computers, Internet of Things devices and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart in-vehicle devices, etc. The portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc.
[0058] In one embodiment, as Figure 2 shown, a storage device control method is provided, which is applied to a data storage device. Taking the method applied to Figure 1 the terminal 102 in it as an example for illustration, the method includes the following steps:
[0059] Step S100, in response to a storage instruction from the host computer, obtain at least one data stream channel corresponding to the storage instruction, as well as the hard disk status information and module performance information corresponding to each intelligent control module.
[0060] Among them, the host computer can be a server or a user terminal, etc. The host computer is connected to the data storage device through the terminal 102. The host computer sends a storage instruction to the terminal 102, so that the terminal 102 controls the corresponding intelligent control module to perform data storage based on this storage instruction. The storage instruction can include data stream channel information, such as the number of data stream channels, the expected occupied storage space size, etc.
[0061] The data stream channel is a path for data transmission and can be a channel divided according to different stream data.
[0062] The data storage device includes a plurality of intelligent control modules. The intelligent control module can be a processor or a controller. For example, it can be a Central Processing Unit (CPU), a general-purpose processor, an Artificial Intelligence (AI) chip, a Graphics Processing Unit (GPU), a Digital Signal Processor (DSP), an Application-Specific Integrated Circuit (ASIC), a Field Programmable Gate Array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. The processor can also be a combination that implements computing functions and / or control functions. For example, it can include a combination of one or more microprocessors, a combination of a DSP and a microprocessor, or a combination of a CPU and a GPU or an AI chip, etc. Correspondingly, the intelligent control module can have external network ports open. Different intelligent control modules can have one to multiple network ports open according to their access capabilities or data processing capabilities of the data flow channels.
[0063] Each of the intelligent control modules is respectively connected to at least one hard disk. The connected hard disk can be one or more of a Hard Disk Drive (HDD), a Solid State Drive (SSD), or a Solid State Hybrid Drive (SSH).
[0064] The hard disk status information can be the hard disk status information of each hard disk. Exemplarily, the hard disk status information can include the load condition, health status, etc. of the hard disk, so as to evaluate whether the hard disk has the ability to access the corresponding data flow channel.
[0065] The module performance information can be the module performance information of each intelligent control module. Exemplarily, it can include the load condition, processing capacity evaluation, etc. of each intelligent control module, and is used to determine whether it can meet the processing capacity of the corresponding data flow channel.
[0066] Step S200: Based on the hard disk status information and the module performance information, allocate at least one corresponding data flow channel to each of the intelligent control modules, so that the intelligent control modules receive the flow data through the data flow channels and compress and store the flow data in the hard disks.
[0067] Among them, based on the hard disk status information and module performance information, allocating at least one corresponding data stream channel to each of the intelligent control modules may be to calculate the data stream channels that each intelligent control module and its corresponding hard disk can simultaneously bear according to the hard disk status information and module performance information, and allocate at least one corresponding data stream channel to each intelligent control module according to the data stream channels that each intelligent control module and its corresponding hard disk can simultaneously bear.
[0068] Exemplarily, when the module performance information of the intelligent control module can bear three data stream channels, and the data stream channels that can be borne corresponding to the hard disk status information are two, then the two data stream channels can be allocated to the intelligent control module.
[0069] The intelligent control module receives the stream data through the data stream channel and compresses and stores the stream data in the hard disk, which may be to implement compression processing through the intelligent compression algorithm in the intelligent control module, and after compression, store the compressed data in the hard disk.
[0070] A storage device control method provided in this embodiment, by responding to a storage instruction of a host computer, obtains at least one data stream channel corresponding to the storage instruction, as well as the hard disk status information and module performance information corresponding to each intelligent control module; based on the hard disk status information and module performance information, allocates at least one corresponding data stream channel to each of the intelligent control modules, so that the intelligent control module receives the stream data through the data stream channel and compresses and stores the stream data in the hard disk. It is a decentralized method that allocates the corresponding data stream channels to each intelligent control module according to the data that each intelligent control module can process. The intelligent control module independently processes the stream data in the accessed data stream channel, which can avoid the overheating problem caused by the centralized processing of the CPU computing module. Through the compression algorithm of the intelligent control module, more video data can also be stored in the hard disk of the same capacity, so as to achieve the effects of improving the data storage capacity and reducing the device power consumption.
[0071] In one of the embodiments, the allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and module performance information includes:
[0072] Based on at least one of the number of disk positions, the hard disk slots, and the hard disk capacity, determine the first processable channel threshold of each intelligent control module;
[0073] Based on the first processable channel threshold and the module performance information, allocate at least one corresponding data stream channel to each of the intelligent control modules.
[0074] Among them, the hard disk status information includes at least one of the number of disk positions, hard disk slots, and hard disk capacity. The number of disk positions can be the number of hard disks connected to the intelligent control module. The hard disk slot can be the specific position of each hard disk in the storage device, which can be understood as the physical layout of the hard disk in the storage device. The hard disk capacity can be the capacity of each hard disk or the total capacity of all hard disks, used to evaluate the overall storage capacity and remaining available space of the storage device.
[0075] The first processable channel threshold can be the maximum number of data stream channels that the current hard disk can bear determined according to the hard disk status information, ensuring that each hard disk will not be overloaded when storing stream data.
[0076] Exemplarily, the corresponding processable channel thresholds can be determined respectively according to the number of disk positions, hard disk slots, and hard disk capacity, and then the minimum value of the above thresholds can be taken as the first processable channel threshold.
[0077] A storage device control method provided in this embodiment can monitor the status of each hard disk by determining the first processable channel threshold according to the hard disk status information, and then allocating data stream channels according to the first processable channel threshold and module performance information, so as to achieve a more refined and intelligent data stream channel allocation, thereby improving the data storage efficiency, enhancing the system stability and resource utilization rate, and achieving the effects of improving the data storage capacity and reducing the device power consumption.
[0078] In one of the embodiments, the module performance information includes data access capability and / or data compression capability; based on the hard disk status information and the module performance information, allocating at least one corresponding data stream channel to each of the intelligent control modules includes:
[0079] Determining a second processable channel threshold for each intelligent control module based on the data access capability and / or the data compression capability;
[0080] Allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the second processable channel threshold.
[0081] Among them, the module performance information can include data access capability or data compression capability. The data access capability can be the number of data flow channels and the rate that the intelligent control module can process simultaneously. The data compression capability can be the ability of the intelligent control module to efficiently compress data. Exemplarily, it can include the efficiency of the compression algorithm, the computing power of the processor, etc.
[0082] The second processable channel threshold may be the maximum number of data stream channels that can be carried determined by the intelligent control module according to the data access capability and / or data compression capability, ensuring that each hard disk will not be overloaded when storing stream data.
[0083] Exemplarily, the corresponding processable channel thresholds can be determined according to the data access capability and the data compression capability respectively, and then the minimum value of the above thresholds is taken as the second processable channel threshold.
[0084] A storage device control method provided in this embodiment can monitor the status of each hard disk by determining the second processable channel threshold according to the module performance information, and then allocating data stream channels according to the second processable channel threshold and the hard disk status information, so as to achieve a more refined and intelligent data stream channel allocation, thereby improving the data storage efficiency, enhancing the system stability and resource utilization rate, and achieving the effects of improving the data storage capacity and reducing the device power consumption.
[0085] In one embodiment, the step of allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information further includes:
[0086] Obtaining the working status of each intelligent control module;
[0087] Based on the hard disk status information and the module performance information, allocating at least one corresponding data stream channel to each of the intelligent control modules with normal working status.
[0088] Exemplarily, obtaining the working status of each intelligent control module may be to analyze and judge the current working status of the intelligent control module according to the operation information reported by the intelligent control module in real time or the operation information obtained in response to a storage instruction. The working status can be normal or abnormal to screen the intelligent control modules for which data stream channels can be allocated. Further, the operation information may include online status, fault report information, CPU utilization rate, memory usage, etc.
[0089] In another embodiment, the working status may be the status information reported by the intelligent control module based on an instruction or actively, and may include but is not limited to working statuses such as online status, fault status, and load status.
[0090] In this embodiment, the normal or abnormal status of the current intelligent control module can be judged according to the working status of the intelligent control module, and at least one corresponding data stream channel can be allocated to the intelligent control module with normal working status.
[0091] A storage device control method provided in this embodiment can achieve dynamic allocation of data flow channels by allocating at least one corresponding data flow channel to each intelligent control module with normal working status, ensuring that each intelligent control module and hard disk can work within their optimal performance ranges, avoiding the problem that some modules or hard disks are in a high-load state for a long time while other modules or hard disks are idle, thereby realizing the optimal utilization of resources and achieving the effects of improving data storage capacity and reducing device power consumption.
[0092] In one embodiment, the storage device control method further includes:
[0093] Generating a stream data acquisition instruction in response to a read instruction from the host computer;
[0094] Sending the stream data acquisition instruction to the intelligent control module corresponding to the read instruction;
[0095] Receiving the stream data sent by the intelligent control module;
[0096] Forwarding the stream data to the host computer.
[0097] Among them, the read instruction can be an instruction sent by the host computer for obtaining specific data in the hard disk. Exemplarily, the read instruction can include information such as the location and size of the data to be read.
[0098] Generating a stream data acquisition instruction can be used to send to the intelligent control module to read the corresponding target data.
[0099] Furthermore, after receiving the stream data acquisition instruction, the intelligent control module can obtain the corresponding compressed data according to the data location and data size in the stream data acquisition instruction. The intelligent control module can forward the decompressed stream data to the host computer after decompressing the compressed data.
[0100] A storage device control method provided in this embodiment can ensure the efficiency and reliability of data storage and reading by responding to the read instruction to obtain the stream data acquisition instruction and sending it to the corresponding intelligent control module, thereby improving the efficiency of data storage and reading and achieving the effects of improving data storage capacity and reducing device power consumption.
[0101] It should be understood that although the steps in the flowcharts involved in the above-described embodiments are sequentially shown according to the indication of the arrows, these steps are not necessarily executed sequentially in the order indicated by the arrows. Unless there is a clear indication in this article, the execution of these steps has no strict order limit, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-described embodiments may include multiple steps or multiple stages. These steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these steps or stages is not necessarily sequential, but can be executed alternately or alternately with at least a part of the steps or stages in other steps or other steps.
[0102] Based on the same inventive concept, an embodiment of the present application also provides a data storage device for implementing the above-mentioned storage device control method. The solution provided by this device to solve the problem is similar to the solution described in the above method. Therefore, the specific limitations in one or more embodiments of the data storage device provided below can refer to the limitations on the storage device control method in the above text, and will not be repeated here.
[0103] In one embodiment, as Figure 3 shown, a data storage device is provided. The data storage device includes a processor management module 100 and a plurality of intelligent control modules 200, wherein:
[0104] The processor management module 100 is respectively connected to the plurality of intelligent control modules 200; each intelligent control module 200 is respectively connected to at least one hard disk;
[0105] The processor management module 100 is configured to, in response to a storage instruction from a host computer, send an information acquisition instruction to each intelligent control module 200; acquire at least one data stream channel corresponding to the storage instruction, and receive hard disk status information and module performance information corresponding to each intelligent control module 200; based on the hard disk status information and module performance information, allocate a corresponding at least one data stream channel to each intelligent control module 200;
[0106] The intelligent control module 200 is configured to, based on the information acquisition instruction, send the hard disk status information and module performance information to the processor management module 100; receive stream data through the data stream channel allocated by the processor management module 100, and compress and store the stream data in the hard disk.
[0107] Among them, the processor management module 100 is used to process the storage instruction of the host computer, process the allocation of the data stream channel, and coordinate the storage and reading operations of each intelligent control module 200.
[0108] In one embodiment, as Figure 4 shown, the data storage device further includes a network switching module 300. The processor management module 100 is connected to a plurality of the intelligent control modules 200 through the network switching module 300. The network switching module 300 is also connected to a plurality of data stream channels;
[0109] The processor management module 100 is further configured to generate a channel allocation instruction based on the hard disk status information and the module performance information;
[0110] The network switching module 300 is configured to allocate at least one corresponding data stream channel to each of the intelligent control modules 200 based on the channel allocation instruction.
[0111] Among them, the network switching module 300 is respectively connected to the data stream channel, the processor management module 100, and the intelligent control module 200, serving as the management and allocation center of the data stream channel, and allocating the corresponding data stream channel to the corresponding intelligent control module 200 according to the channel allocation instruction sent by the processor management module 100.
[0112] Furthermore, the network switching module may be externally deployed with network data ports to access the data stream channels through the network data ports. The processor management module 100 may be externally deployed with network management ports and connected to the host computer through the network management ports.
[0113] Furthermore, the host computer may be a platform server or a client.
[0114] A data storage device provided in this embodiment, with the network switching module 300 as the center among the data stream channel, the processor management module 100, and the intelligent control module 200, can further optimize the management and allocation of the data stream channel of the data storage device, improve the flexibility and efficiency of the system, and thus can achieve the effects of improving the data storage capacity and reducing the device power consumption.
[0115] In one embodiment, the hard disk status information includes at least one of the number of disk positions, the hard disk slots, and the hard disk capacity; the processor management module is further configured to:
[0116] Determine a first processable channel threshold for each intelligent control module based on at least one of the number of disk positions, the hard disk slots, and the hard disk capacity;
[0117] Allocate at least one corresponding data stream channel to each of the intelligent control modules based on the first processable channel threshold and the module performance information.
[0118] In one embodiment, the module performance information includes data access capability and / or data compression capability; the processor management module is further configured to:
[0119] Based on the data access capability and / or the data compression capability, determine the second processable channel threshold for each intelligent control module;
[0120] Based on the hard disk status information and the second processable channel threshold, allocate at least one corresponding data stream channel to each of the intelligent control modules.
[0121] In one embodiment, the processor management module is further configured to:
[0122] Obtain the working status of each intelligent control module;
[0123] Based on the hard disk status information and the module performance information, allocate at least one corresponding data stream channel to each of the intelligent control modules with normal working status.
[0124] In one embodiment,
[0125] The processor management module is further configured to: in response to a read instruction from the host computer, generate a stream data acquisition instruction; send the stream data acquisition instruction to the intelligent control module corresponding to the read instruction; receive the stream data sent by the intelligent control module; forward the stream data to the host computer;
[0126] The intelligent control module is further configured to: in response to the stream data acquisition instruction, send the stream data corresponding to the stream data acquisition instruction in the hard disk to the processor management module.
[0127] In one embodiment, the intelligent control module is connected to the hard disk through the SATA bus, and the intelligent control module is further configured to:
[0128] Perform data pulling through the data stream channel allocated by the processor management module to obtain stream data;
[0129] Decode, intelligently compress, and encode the stream data in sequence to obtain compressed stream data;
[0130] Write the compressed stream data into the hard disk.
[0131] In one embodiment, a storage server is provided, and the data storage device described in any of the above embodiments is provided in the storage server.
[0132] The data storage device includes a processor management module and a plurality of intelligent control modules, wherein:
[0133] The processor management module is respectively connected to a plurality of the intelligent control modules; each of the intelligent control modules is respectively connected to at least one hard disk;
[0134] The processor management module is configured to, in response to a storage instruction from a host computer, send an information acquisition instruction to each of the intelligent control modules; acquire at least one data stream channel corresponding to the storage instruction, and receive the hard disk status information and module performance information corresponding to each intelligent control module; and allocate the corresponding at least one data stream channel to each of the intelligent control modules based on the hard disk status information and module performance information.
[0135] The intelligent control module is configured to send the hard disk status information and module performance information to the processor management module based on the information acquisition instruction; receive stream data through the data stream channel allocated by the processor management module, and compress and store the stream data in the hard disk.
[0136] Each module in the above data storage device can be implemented in whole or in part by software, hardware, and their combination. Each of the above modules can be embedded in the processor of the computer device in hardware form or be independent of it, or can be stored in the memory of the computer device in software form, so as to facilitate the processor to call and execute the operations corresponding to each of the above modules.
[0137] To elaborate the technical solution of the present application in more detail, the present application also provides a detailed embodiment.
[0138] In one embodiment, as Figure 5 shown, a storage server is provided, and further, a distributed intelligent compression storage server. The storage server includes a network switching module, a CPU management module (i.e., the processor management module), an intelligent controller (i.e., the intelligent control module), and a hard disk, where the hard disk can be a storage medium hard disk HDD.
[0139] The CPU management module is connected to the host computer through a network management port. The host computer is a platform server or a client, and the platform server or the client can manage the device or issue tasks through this network port. The CPU management module is also connected to the network switching module through a network, and is respectively connected to the first to the nth intelligent controllers through out-of-band management buses 1 to out-of-band management buses n. Each intelligent controller is respectively connected to one or more hard disks. Exemplarily, intelligent controller 1 is connected to hard disk HDD-1 through SATA / SAS, intelligent controller 2 is connected to hard disk HDD-2 through SATA / SAS, intelligent controller n is connected to hard disk HDD-n through SATA / SAS, and each intelligent controller is also respectively connected to the network switching module through a network.
[0140] The network switching module is connected to the network data port through the network, and the network data port is connected to several data stream channels. In this embodiment, the data stream channels include IPC video stream channel 1, IPC video stream channel 2, and IPC video stream channel 3. The data stream channels can also be channels including other media streams or data streams. This embodiment does not limit the type and quantity of the data streams.
[0141] During use, when the device is powered on, the intelligent controller obtains hard disk slot information, disk position information, capacity information, etc. through the SATA / SAS bus. For example, how many hard disks are connected under intelligent control 1, which slots they are in respectively, and what their capacities are; at the same time, these information are reported to the CPU management module through the out-of-band management bus, and the CPU management module performs unified slot mapping and unified operation and maintenance management on all hard disks in the device. At the same time, the CPU management module obtains the performance information of the intelligent controller through the out-of-band management bus, such as video access capability (how many channels can be accessed) and video compression capability of the intelligent controller, etc., which is convenient for the CPU management controller to perform task allocation, scheduling, and load balancing management.
[0142] The platform server issues tasks to the CPU management module through the network management port. The task information includes the number of IPC video channels, video channel IP addresses, etc. After receiving the tasks, the CPU management module distributes the IPC video stream channels to each intelligent controller and the hard disks managed by the corresponding intelligent controller according to the performance of the intelligent controller, hard disk capacity, quantity, etc., thus forming a binding relationship among the IPC video stream channels, intelligent controllers, and hard disks. The binding relationship between video recording and hard disks is also managed by the CPU management module.
[0143] For the realization of video storage, the intelligent controller performs video stream pulling according to the obtained IPC video stream channel IP address, decodes the pulled video stream first, then performs intelligent compression through AI computing power, then encodes the compressed video stream, and then writes the encoded video stream into the hard disk for storage through the SATA / SAS bus.
[0144] For the realization of video playback, the platform issues a playback service to the CPU management module. For example, when playing back IPC video channel 1, the CPU management module issues a signaling to the intelligent controller 1 through the network switching module, and the intelligent controller 1 reads out the video stream from the hard disk and forwards it to the platform for decoding and playback.
[0145] Reliability Cluster Implementation of Distributed Intelligent Compression Storage Server: The CPU management module monitors the keep-alive status of the intelligent controller in real time. When it detects that the intelligent controller is working abnormally, it schedules the original services of the intelligent controller to other intelligent controllers, including relevant IPC video stream channels and pull-stream IP addresses, etc. Other intelligent controllers take over the work of pulling the stream, decoding, intelligent compression, and encoding to ensure the reliability and continuity of the whole machine's services.
[0146] A storage server provided in this embodiment provides an intelligent compression storage server solution with CPU decentralization. Each hard disk or each group of hard disks is paired with an intelligent controller to form each distributed storage node. The work of a large amount of data access and forwarding is distributed to each intelligent controller node, and the video is compressed by the intelligent controller and then stored. On the one hand, it greatly reduces the performance requirements of the CPU, so that the CPU no longer becomes the bottleneck of video storage, and the power consumption and cost of the device can be reduced by reducing the CPU specification; on the other hand, through the compression algorithm of the intelligent controller, the same-capacity hard disk can store more video data. At the same time, the distributed intelligent compression storage server has a network cluster architecture inside the device, which can realize flexible scheduling of tasks, ensure load balancing, and effectively improve the reliability of storage.
[0147] In one embodiment, each intelligent controller and the hard disk under this intelligent controller can be installed in the same hard disk enclosure. In the whole machine device, multiple hard disk enclosure components are inserted and networked through the network switching module, and task scheduling and management are carried out through the CPU management module, realizing a distributed multi-disk intelligent compression storage server.
[0148] As Figure 6 shown, a mechanical hard disk is installed in the hard disk enclosure, and a circuit board is installed, which contains an intelligent controller, that is, an AI controller and a control board component. The AI controller includes an AI calculation module. At the same time, on one side, it is a SATA female socket for internal connection and is interconnected with the hard disk through the SATA bus; on the other side, it is a SATA / SAS male socket and can be connected to a standard SATA / SAS female socket. The externally connected signal is the network signal RGMII, and the video code stream is accessed through the externally connected interface component.
[0149] The process of realizing storage is as follows: The externally connected interface accesses the encoded video code stream through the network signal RGMII. The AI calculation module is responsible for decoding the video code stream, and then performs compression processing on the code stream through a specific compression algorithm. After compression is completed, video encoding is performed again. After encoding is completed, the compressed and encoded code stream is stored in the hard disk through the internal SATA bus.
[0150] With the above settings of the hard disk enclosure, assuming the physical capacity is 10TB, the actually connectable video stream exceeds 10TB. Simply put, a 15TB stream of data is compressed to only 9TB and stored in a hard disk with a physical capacity of 10TB, thereby effectively improving the efficiency and multiple of video storage, achieving the effects of improving data storage capacity and reducing device power consumption.
[0151] In one embodiment, a storage server is provided, including a data storage device as described in any of the above embodiments:
[0152] The data storage device includes a processor management module and a plurality of intelligent control modules, where:
[0153] The processor management module is respectively connected to the plurality of intelligent control modules; each intelligent control module is respectively connected to at least one hard disk;
[0154] The processor management module is configured to, in response to a storage instruction from a host computer, send an information acquisition instruction to each intelligent control module; acquire at least one data stream channel corresponding to the storage instruction, and receive the hard disk status information and module performance information corresponding to each intelligent control module; based on the hard disk status information and module performance information, allocate the corresponding at least one data stream channel to each intelligent control module;
[0155] The intelligent control module is configured to, based on the information acquisition instruction, send the hard disk status information and module performance information to the processor management module; receive the stream data through the data stream channel allocated by the processor management module, and compress and store the stream data in the hard disk.
[0156] In one embodiment, a computer device is provided. This computer device can be a server, and its internal structure diagram can be as Figure 7 shown. The computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program, and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store stream data. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, it implements a storage device control method.
[0157] Those skilled in the art can understand, Figure 7The structure shown is only a block diagram of some structures related to the solution of this application, and does not constitute a limitation on the computer device to which the solution of this application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have a different component layout.
[0158] In one embodiment, a computer device is provided, including a memory and a processor. A computer program is stored in the memory. When the processor executes the computer program, the storage device control method of any of the above embodiments is implemented:
[0159] In response to a storage instruction from a host computer, obtain at least one data stream channel corresponding to the storage instruction, as well as the hard disk status information and module performance information corresponding to each intelligent control module;
[0160] Based on the hard disk status information and module performance information, allocate at least one corresponding data stream channel to each intelligent control module, so that the intelligent control module receives stream data through the data stream channel and compresses and stores the stream data in the hard disk.
[0161] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the storage device control method of any of the above embodiments is implemented:
[0162] In response to a storage instruction from a host computer, obtain at least one data stream channel corresponding to the storage instruction, as well as the hard disk status information and module performance information corresponding to each intelligent control module;
[0163] Based on the hard disk status information and module performance information, allocate at least one corresponding data stream channel to each intelligent control module, so that the intelligent control module receives stream data through the data stream channel and compresses and stores the stream data in the hard disk.
[0164] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.
[0165] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, database, or other medium used in the embodiments provided in the present application can include at least one of non-volatile and volatile memories. Non-volatile memories can include read-only memory (ROM), magnetic tapes, floppy disks, flash memories, optical memories, high-density embedded non-volatile memories, resistive random access memories (ReRAM), magnetoresistive random access memories (MRAM), ferroelectric random access memories (FRAM), phase change memories (PCM), graphene memories, etc. Volatile memories can include random access memory (RAM) or external cache memories, etc. By way of illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM), etc. The databases involved in the embodiments provided in the present application can include at least one of relational databases and non-relational databases. Non-relational databases can include distributed databases based on blockchain, etc., without limitation. The processors involved in the embodiments provided in the present application can be general-purpose processors, central processors, graphics processors, digital signal processors, programmable logic devices, data processing logics based on quantum computing, etc., without limitation.
[0166] The technical features of the above embodiments can be combined arbitrarily. For the sake of concise description, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, it should be considered as the scope recorded in this specification.
[0167] The above-described embodiments merely represent several implementation manners of the present application. Their descriptions are relatively specific and detailed, but they should not be construed as limiting the patent scope of the present application. It should be noted that for those of ordinary skill in the art, without departing from the concept of the present application, several modifications and improvements can still be made, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the appended claims.
Claims
1. A storage device control method, characterized in that: Applied to a data storage device, the data storage device includes a plurality of intelligent control modules, each of the intelligent control modules is respectively connected to at least one hard disk, and the storage device control method includes: In response to a storage instruction of the host computer, obtaining at least one data stream channel corresponding to the storage instruction, and hard disk status information and module performance information corresponding to each intelligent control module; Based on the hard disk status information and module performance information, the data stream channels that each intelligent control module and its corresponding hard disk can simultaneously carry are calculated, and at least one corresponding data stream channel is allocated to each intelligent control module, so that the intelligent control module receives stream data through the data stream channel and compresses and stores the stream data in the hard disk; The hard disk status information includes at least one of the number of disk slots, hard disk slots and hard disk capacity; the allocation of at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information includes: determining the first processable channel threshold of each intelligent control module based on at least one of the number of disk slots, the hard disk slots and the hard disk capacity; allocating at least one corresponding data stream channel to each of the intelligent control modules based on the first processable channel threshold and the module performance information; or, the module performance information includes data access capability and / or data compression capability; the allocation of at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information includes: determining the second processable channel threshold of each intelligent control module based on the data access capability and / or the data compression capability; allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the second processable channel threshold.
2. The storage device control method according to claim 1, characterized in that: The allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information further comprises: Obtaining the working status of each of the intelligent control modules; Based on the hard disk status information and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules in normal working status.
3. The storage device control method according to claim 1, characterized in that: The storage device control method further includes: In response to a read instruction from a host computer, a stream data acquisition instruction is generated; Sending the stream data acquisition instruction to the intelligent control module corresponding to the read instruction; Receiving stream data sent by the intelligent control module; The stream data is forwarded to the host computer.
4. A data storage device, characterized in that: The data storage device includes a processor management module and a plurality of intelligent control modules, wherein: The processor management module is respectively connected to the plurality of intelligent control modules; each of the intelligent control modules is respectively connected to at least one hard disk; The processor management module is used to respond to the storage instruction of the host computer and send an information acquisition instruction to each of the intelligent control modules; obtain at least one data flow channel corresponding to the storage instruction, and receive the hard disk status information and module performance information corresponding to each intelligent control module; based on the hard disk status information and module performance information, calculate the data flow channels that each intelligent control module and its corresponding hard disk can carry simultaneously, and allocate at least one corresponding data flow channel to each of the intelligent control modules; the hard disk status information includes at least one of the number of disk slots, hard disk slots and hard disk capacity; the allocation of at least one corresponding data flow channel to each of the intelligent control modules based on the hard disk status information and module performance information includes: based on the number of disk slots, the number of hard disk slots and the number of hard ... At least one of the hard disk slot and the hard disk capacity is used to determine a first processable channel threshold of each intelligent control module; based on the first processable channel threshold and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules; or, the module performance information includes data access capability and / or data compression capability; the allocation of at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information includes: determining a second processable channel threshold of each intelligent control module based on the data access capability and / or the data compression capability; and allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the second processable channel threshold; The intelligent control module is used to send hard disk status information and module performance information to the processor management module based on the information acquisition instruction; receive stream data through the data stream channel allocated by the processor management module, and compress and store the stream data in the hard disk.
5. The data storage device according to claim 4, characterized in that: The data storage device further comprises a network switching module, the processor management module is connected to the plurality of intelligent control modules via the network switching module, and the network switching module is also connected to a plurality of data flow channels; The processor management module is also used to generate a channel allocation instruction based on the hard disk status information and the module performance information; The network switching module is used to allocate at least one corresponding data flow channel to each of the intelligent control modules based on the channel allocation instruction.
6. The data storage device according to claim 4, characterized in that: The hard disk status information includes at least one of the number of hard disk slots, hard disk slots, and hard disk capacity; the processor management module is also used for: Determine a first processable channel threshold of each intelligent control module based on at least one of the number of disk slots, the hard disk slots, and the hard disk capacity; Based on the first processable channel threshold and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
7. The data storage device according to claim 4, characterized in that: The module performance information includes data access capability and / or data compression capability; the processor management module is also used for: Determine a second processable channel threshold of each intelligent control module based on the data access capability and / or the data compression capability; Based on the hard disk status information and the second processable channel threshold, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
8. The data storage device according to claim 4, characterized in that: The processor management module is also used for: Obtaining the working status of each of the intelligent control modules; Based on the hard disk status information and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules in normal working status.
9. The data storage device according to claim 4, characterized in that: The processor management module is also used to: generate a stream data acquisition instruction in response to a read instruction from the host computer; send the stream data acquisition instruction to the intelligent control module corresponding to the read instruction; receive the stream data sent by the intelligent control module; and forward the stream data to the host computer; The intelligent control module is further configured to: in response to the stream data acquisition instruction, send the stream data corresponding to the stream data acquisition instruction in the hard disk to the processor management module.
10. The data storage device according to claim 4, characterized in that: The intelligent control module is connected to the hard disk via a SATA bus, and the intelligent control module is also used for: Pulling data through the data stream channel allocated by the processor management module to obtain stream data; Decoding, intelligently compressing and encoding the stream data in sequence to obtain compressed stream data; The compressed stream data is written into the hard disk.
11. A storage server, characterized in that: The storage server is provided with a data storage device as claimed in any one of claims 4 to 10.
12. A computer device comprising a memory and a processor, wherein the memory stores a computer program, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 3 is implemented.
13. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 3 is implemented.
Citation Information
Patent Citations
Data operation method and device, equipment and medium
CN113885798A
Data processing equipment
CN118972345A