Storage device control method and device, storage server and computer equipment
By using intelligent control modules in the storage device to dynamically allocate data flow channels and compressed storage, the problems of low data storage capacity and high power consumption are solved, and efficient data storage and reduced device power consumption are achieved.
Patent Information
- Application Number
- CN202411709324.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-27
- Publication Date
- 2024-12-27
- Estimated Expiration
- 2044-11-27
AI Technical Summary
The existing data storage field has problems such as low data storage capacity and high device power consumption, which is difficult to cope with the explosive growth of storage needs. At the same time, upgrading CPU computing modules will lead to heat dissipation problems.
By introducing multiple intelligent control modules into the storage device, each module is connected to the hard disk, and dynamically allocates data flow channels based on the hard disk status information and module performance information, realizing decentralized data flow processing and compressed storage, avoiding the centralized processing of the CPU. overheating and improving the storage efficiency of the hard disk.
It improves data storage capabilities, reduces device power consumption, avoids CPU overheating, and allows hard disks of the same capacity to store more video data, enhancing the stability and resource utilization of the system.
Smart Images

Figure CN119201477A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of data compression, and in particular to a storage device control method, device, storage server and computer equipment. Background Art
[0002] With the rise of the self-media era, the storage pressure on servers for video data is increasing due to the increase in smart devices, higher video resolution, and longer user storage cycle requirements.
[0003] Nowadays, in order to cope with storage pressure, the server storage space is usually expanded or the CPU computing module is upgraded. However, expanding the storage space is difficult to cope with the explosive growth of storage demand, and upgrading the CPU computing module will also increase power consumption, resulting in abnormal heat dissipation.
[0004] It can be seen that the current data storage field still has problems such as low data storage capacity and high device power consumption. Summary of the invention
[0005] Based on this, it is necessary to provide a storage device control method, device, storage server and computer equipment that can improve data storage capacity and reduce device power consumption in response to the above technical problems.
[0006] In a first aspect, the present application provides a storage device control method, which is applied to a data storage device, wherein the data storage device includes a plurality of intelligent control modules, each of which is respectively connected to at least one hard disk, and the storage device control method includes: In response to a storage instruction of the host computer, obtaining at least one data stream channel corresponding to the storage instruction, and hard disk status information and module performance information corresponding to each intelligent control module; Based on the hard disk status information and module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules, so that the intelligent control module receives stream data through the data stream channel and compresses and stores the stream data in the hard disk.
[0007] In one embodiment, the hard disk status information includes at least one of the number of hard disk slots, hard disk slots, and hard disk capacity; and the allocating corresponding at least one data stream channel to each of the intelligent control modules based on the hard disk status information and module performance information includes: Determine a first processable channel threshold of each intelligent control module based on at least one of the number of disk slots, the hard disk slots, and the hard disk capacity; Based on the first processable channel threshold and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
[0008] In one embodiment, the module performance information includes data access capability and / or data compression capability; and the allocating corresponding at least one data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information includes: Determine a second processable channel threshold of each intelligent control module based on the data access capability and / or the data compression capability; Based on the hard disk status information and the second processable channel threshold, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
[0009] In one embodiment, allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information further comprises: Obtaining the working status of each of the intelligent control modules; Based on the hard disk status information and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules in normal working status.
[0010] In one embodiment, the storage device control method further includes: In response to a read instruction from a host computer, a stream data acquisition instruction is generated; Sending the stream data acquisition instruction to the intelligent control module corresponding to the read instruction; Receiving stream data sent by the intelligent control module; The stream data is forwarded to the host computer.
[0011] In a second aspect, the present application provides a data storage device, the data storage device comprising a processor management module and a plurality of intelligent control modules, wherein: The processor management module is respectively connected to the plurality of intelligent control modules; each of the intelligent control modules is respectively connected to at least one hard disk; The processor management module is used to respond to the storage instruction of the host computer and send an information acquisition instruction to each of the intelligent control modules; obtain at least one data flow channel corresponding to the storage instruction, and receive the hard disk status information and module performance information corresponding to each intelligent control module; based on the hard disk status information and module performance information, allocate at least one corresponding data flow channel to each of the intelligent control modules; The intelligent control module is used to send hard disk status information and module performance information to the processor management module based on the information acquisition instruction; receive stream data through the data stream channel allocated by the processor management module, and compress and store the stream data in the hard disk.
[0012] In one embodiment, the data storage device further comprises a network switching module, the processor management module is connected to the plurality of intelligent control modules via the network switching module, and the network switching module is also connected to a plurality of data flow channels; The processor management module is also used to generate a channel allocation instruction based on the hard disk status information and the module performance information; The network switching module is used to allocate at least one corresponding data flow channel to each of the intelligent control modules based on the channel allocation instruction.
[0013] In one embodiment, the hard disk status information includes at least one of the number of hard disk slots, hard disk slots, and hard disk capacity; and the processor management module is further configured to: Determine a first processable channel threshold of each intelligent control module based on at least one of the number of disk slots, the hard disk slots, and the hard disk capacity; Based on the first processable channel threshold and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
[0014] In one embodiment, the module performance information includes data access capability and / or data compression capability; the processor management module is further configured to: Determine a second processable channel threshold of each intelligent control module based on the data access capability and / or the data compression capability; Based on the hard disk status information and the second processable channel threshold, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
[0015] In one embodiment, the processor management module is further configured to: Obtaining the working status of each of the intelligent control modules; Based on the hard disk status information and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules in normal working status.
[0016] In one embodiment, The processor management module is also used to: generate a stream data acquisition instruction in response to a read instruction from the host computer; send the stream data acquisition instruction to the intelligent control module corresponding to the read instruction; receive the stream data sent by the intelligent control module; and forward the stream data to the host computer; The intelligent control module is further configured to: in response to the stream data acquisition instruction, send the stream data corresponding to the stream data acquisition instruction in the hard disk to the processor management module.
[0017] In one embodiment, the intelligent control module is connected to the hard disk via a SATA bus, and the intelligent control module is further used for: Pulling data through the data stream channel allocated by the processor management module to obtain stream data; Decoding, intelligently compressing and encoding the stream data in sequence to obtain compressed stream data; The compressed stream data is written into the hard disk.
[0018] In a third aspect, the present application provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and the processor implements the above-mentioned method when executing the computer program.
[0019] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program implements the method described above when executed by a processor.
[0020] The above-mentioned storage device control method, device, storage server and computer equipment obtain at least one data flow channel corresponding to the storage instruction and the hard disk status information and module performance information corresponding to each intelligent control module by responding to the storage instruction of the upper computer; based on the hard disk status information and module performance information, at least one corresponding data flow channel is allocated to each of the intelligent control modules, so that the intelligent control module receives the flow data through the data flow channel, and compresses the flow data and stores it in the hard disk. It is in a decentralized manner. According to the data that each intelligent control module can process, the corresponding data flow channel is allocated to each intelligent control module respectively. The intelligent control module independently processes the flow data in the connected data flow channel, which can avoid the overheating problem caused by the centralized processing of the CPU computing module. Through the compression algorithm of the intelligent control module, a hard disk of the same capacity can also store more video data, thereby achieving the effect of improving data storage capacity and reducing equipment power consumption. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] Figure 1 A diagram showing an application environment of a storage device control method in an embodiment; Figure 2 is a flow chart of a storage device control method in one embodiment; Figure 3 is a structural block diagram of a data storage device in one embodiment; Figure 4 is a structural block diagram of a data storage device in another embodiment; Figure 5 is a structural block diagram of a storage server in one embodiment; Figure 6A schematic diagram of the structure of a hard disk box in one embodiment; Figure 7 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION
[0022] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.
[0023] The storage device control method provided in the embodiment of the present application can be applied to Figure 1 In the application environment shown. Among them, the terminal 102 is connected to the host computer 104 and multiple intelligent control modules 200 through the network. The terminal 102 responds to the storage instruction of the host computer, obtains at least one data stream channel corresponding to the storage instruction, and the hard disk status information and module performance information corresponding to each intelligent control module; based on the hard disk status information and module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules, so that the intelligent control module receives the stream data through the data stream channel, and compresses and stores the stream data in the hard disk. Among them, the terminal 102 can be, but is not limited to, various personal computers, laptops, smart phones, tablet computers, Internet of Things devices and portable wearable devices. The Internet of Things devices can be smart speakers, smart TVs, smart air conditioners, smart car-mounted devices, etc. Portable wearable devices can be smart watches, smart bracelets, head-mounted devices, etc.
[0024] In one embodiment, Figure 2 As shown, a storage device control method is provided, which is applied to a data storage device. Figure 1 The terminal 102 in the example is used as an example to illustrate, and the following steps are included: Step S100, in response to a storage instruction of a host computer, obtaining at least one data stream channel corresponding to the storage instruction, and hard disk status information and module performance information corresponding to each intelligent control module.
[0025] The host computer may be a server or a user terminal, etc. The host computer is connected to the data storage device through the terminal 102, and the host computer sends a storage instruction to the terminal 102, so that the terminal 102 controls the corresponding intelligent control module to store data based on the storage instruction. The storage instruction may include data stream channel information, such as the number of data stream channels, the estimated size of the storage space occupied, etc.
[0026] The data stream channel is a path for data transmission, and may be a channel divided according to different stream data.
[0027] The data storage device includes multiple intelligent control modules. The intelligent control module can be a processor or a controller, for example, a central processing unit (CPU), a general processor, an artificial intelligence (AI) chip, a graphics processing unit (GPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. The processor can also be a combination that implements computing functions and / or control functions, such as a combination of one or more microprocessors, a combination of DSP and microprocessors, or a combination of CPU and GPU or AI chip, etc. Correspondingly, the intelligent control module can open an external network port, and different intelligent control modules can open one or more network ports according to the access capability or data processing capability of their data flow channels.
[0028] Each of the intelligent control modules is respectively connected to at least one hard disk, and the connected hard disk can be one or more of a mechanical hard disk (Hard Disk Drive, HDD), a solid state drive (Solid State Drive, SSD) or a hybrid hard disk (Solid State Hybrid Drive, SSH).
[0029] The hard disk status information may be the hard disk status information of each hard disk. For example, the hard disk status information may include the load condition, health condition, etc. of the hard disk, so as to be used to evaluate whether the hard disk has the ability to access the corresponding data flow channel.
[0030] The module performance information may be the module performance information of each intelligent control module, and may include, for example, the load condition and processing capability evaluation of each intelligent control module, so as to determine whether the processing capability of the corresponding data flow channel can be met.
[0031] Step S200, based on the hard disk status information and module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules, so that the intelligent control module receives stream data through the data stream channel and compresses and stores the stream data in the hard disk.
[0032] Among them, based on the hard disk status information and the module performance information, at least one corresponding data flow channel is allocated to each of the intelligent control modules. The data flow channels that each intelligent control module and its corresponding hard disk can simultaneously carry are calculated according to the hard disk status information and the module performance information, and at least one corresponding data flow channel is allocated to each intelligent control module according to the data flow channels that the hard disk corresponding to each intelligent control module machine can simultaneously carry.
[0033] Exemplarily, when the module performance information of the intelligent control module can carry three data flow channels, and the hard disk status information can carry two data flow channels, then the two data flow channels can be allocated to the intelligent control module.
[0034] The intelligent control module receives the stream data through the data stream channel and compresses the stream data and stores it in the hard disk. The intelligent compression algorithm in the intelligent control module can be used to achieve compression processing, and after compression, the compressed data is stored in the hard disk.
[0035] A storage device control method provided in this embodiment obtains at least one data flow channel corresponding to the storage instruction and hard disk status information and module performance information corresponding to each intelligent control module by responding to the storage instruction of the upper computer; based on the hard disk status information and module performance information, at least one corresponding data flow channel is allocated to each intelligent control module, so that the intelligent control module receives flow data through the data flow channel, and compresses and stores the flow data in the hard disk. In a decentralized manner, the corresponding data flow channel is allocated to each intelligent control module according to the data that each intelligent control module can process. The intelligent control module independently processes the flow data in the connected data flow channel, which can avoid the overheating problem caused by the centralized processing of the CPU computing module. Through the compression algorithm of the intelligent control module, a hard disk of the same capacity can also store more video data, thereby achieving the effect of improving data storage capacity and reducing device power consumption.
[0036] In one embodiment, allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information comprises: Determine a first processable channel threshold of each intelligent control module based on at least one of the number of disk slots, the hard disk slots, and the hard disk capacity; Based on the first processable channel threshold and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
[0037] The hard disk status information includes at least one of the number of disk slots, hard disk slots, and hard disk capacity. The number of disk slots may be the number of hard disks connected to the intelligent control module. The hard disk slot may be the specific location of each hard disk in the storage device, which may be understood as the physical layout of the hard disk in the storage device. The hard disk capacity may include the capacity of each hard disk or the total capacity of all hard disks, which is used to evaluate the overall storage capacity and remaining available space of the storage device.
[0038] The first processable channel threshold may be the maximum number of data stream channels that the current hard disk can carry, determined according to the hard disk status information, to ensure that each hard disk is not overloaded when storing stream data.
[0039] Exemplarily, the corresponding processable channel thresholds may be determined according to the number of disk slots, hard disk slots, and hard disk capacity, and then the minimum value of the above thresholds is taken as the first processable channel threshold.
[0040] A storage device control method provided in this embodiment can monitor the status of each hard disk and implement more precise and intelligent data flow channel allocation by determining a first processable channel threshold according to hard disk status information and then allocating data flow channels according to the first processable channel threshold and module performance information, thereby improving data storage efficiency, enhancing system stability and resource utilization, and achieving the effect of improving data storage capacity and reducing device power consumption.
[0041] In one embodiment, the module performance information includes data access capability and / or data compression capability; and the allocating corresponding at least one data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information includes: Determine a second processable channel threshold of each intelligent control module based on the data access capability and / or the data compression capability; Based on the hard disk status information and the second processable channel threshold, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
[0042] The module performance information may include data access capability and data compression capability. The data access capability may be the number and rate of data flow paths that the intelligent control module can process simultaneously. The data compression capability may be the ability of the intelligent control module to efficiently compress data, and may include, for example, the efficiency of the compression algorithm, the computing power of the processor, etc.
[0043] The second processable channel threshold may be the maximum number of data stream channels that can be carried, determined by the intelligent control module according to the data access capability and / or the data compression capability, to ensure that each hard disk is not overloaded when storing stream data.
[0044] Exemplarily, the corresponding processable channel thresholds may be determined according to the data access capability and the data compression capability, respectively, and then the minimum value of the above thresholds is taken as the second processable channel threshold.
[0045] A storage device control method provided in this embodiment determines a second processable channel threshold according to module performance information, and then allocates data flow channels according to the second processable channel threshold and hard disk status information. This can monitor the status of each hard disk and achieve more precise and intelligent data flow channel allocation, thereby improving data storage efficiency, enhancing system stability and resource utilization, and achieving the effect of improving data storage capacity and reducing device power consumption.
[0046] In one embodiment, allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information further comprises: Obtaining the working status of each of the intelligent control modules; Based on the hard disk status information and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules in normal working status.
[0047] Exemplarily, obtaining the working status of each intelligent control module may be based on the operating information reported by the intelligent control module in real time, or the operating information obtained in response to the storage instruction, and analyzing and determining the current working status of the intelligent control module. The working status may be normal or abnormal, so as to screen the intelligent control modules that can be allocated data flow channels. Furthermore, the operating information may include online status, fault report information, CPU utilization, memory usage, etc.
[0048] In another embodiment, the working status may be status information reported by the intelligent control module based on instructions or actively, and may include but is not limited to working status such as online status, fault status, and load status.
[0049] In this embodiment, the normality or abnormality of the current intelligent control module can be determined according to the working state of the intelligent control module, and at least one corresponding data flow channel is allocated to the intelligent control module in normal working state.
[0050] A storage device control method provided in this embodiment can realize dynamic allocation of data flow channels by allocating at least one corresponding data flow channel to each of the intelligent control modules in normal working state, thereby ensuring that each intelligent control module and hard disk can operate within its optimal performance range, avoiding the problem that some modules or hard disks are in a high-load state for a long time while other modules or hard disks are idle, thereby realizing optimal utilization of resources and achieving the effect of improving data storage capacity and reducing equipment power consumption.
[0051] In one embodiment, the storage device control method further includes: In response to a read instruction from a host computer, a stream data acquisition instruction is generated; Sending the stream data acquisition instruction to the intelligent control module corresponding to the read instruction; Receiving stream data sent by the intelligent control module; The stream data is forwarded to the host computer.
[0052] The read instruction may be an instruction sent by a host computer for obtaining specific data in a hard disk. For example, the read instruction may include information such as the location and size of the data to be read.
[0053] The stream data acquisition instruction is generated and sent to the intelligent control module to read the corresponding target data.
[0054] Further, after receiving the stream data acquisition instruction, the intelligent control module can obtain the corresponding compressed data according to the stream data acquisition instruction and the data position and data size in the stream data acquisition instruction. The intelligent control module can decompress the compressed data to obtain the stream data and then forward it to the host computer.
[0055] A storage device control method provided in this embodiment can ensure the high efficiency and reliability of data storage and reading by responding to and reading instructions to obtain stream data acquisition instructions and sending them to the corresponding intelligent control module, thereby improving the efficiency of data storage and reading, and achieving the effect of improving data storage capacity and reducing equipment power consumption.
[0056] It should be understood that, although the various steps in the flowcharts involved in the above-mentioned embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above-mentioned embodiments can include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily to be carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.
[0057] Based on the same inventive concept, the embodiment of the present application also provides a data storage device for implementing the storage device control method involved above. The implementation solution provided by the device to solve the problem is similar to the implementation solution recorded in the above method, so the specific limitations in one or more data storage device embodiments provided below can refer to the limitations of the storage device control method above, and will not be repeated here.
[0058] In one embodiment, Figure 3 As shown, a data storage device is provided, the data storage device comprises a processor management module 100 and a plurality of intelligent control modules 200, wherein: The processor management module 100 is respectively connected to a plurality of the intelligent control modules 200; each of the intelligent control modules 200 is respectively connected to at least one hard disk; The processor management module 100 is used to respond to the storage instruction of the host computer and send an information acquisition instruction to each of the intelligent control modules 200; obtain at least one data flow channel corresponding to the storage instruction, and receive the hard disk status information and module performance information corresponding to each intelligent control module 200; based on the hard disk status information and module performance information, allocate at least one corresponding data flow channel to each of the intelligent control modules 200; The intelligent control module 200 is used to send hard disk status information and module performance information to the processor management module 100 based on the information acquisition instruction; receive stream data through the data stream channel allocated by the processor management module 100, and compress and store the stream data in the hard disk.
[0059] The processor management module 100 is used to process storage instructions of the host computer, process the allocation of data flow channels, and coordinate the storage and reading work of each intelligent control module 200.
[0060] In one embodiment, if Figure 4 As shown, the data storage device further includes a network switching module 300, the processor management module 100 is connected to the plurality of intelligent control modules 200 via the network switching module 300, and the network switching module 300 is also connected to a plurality of data flow channels; The processor management module 100 is also used to generate a channel allocation instruction based on the hard disk status information and the module performance information; The network switching module 300 is used to allocate at least one corresponding data flow channel to each of the intelligent control modules 200 based on the channel allocation instruction.
[0061] Among them, the network switching module 300 is connected to the data flow channel, the processor management module 100 and the intelligent control module 200 respectively, serving as the management and allocation center of the data flow channel, and allocates the corresponding data flow channel to the corresponding intelligent control module 200 according to the channel allocation instruction sent by the processor management module 100.
[0062] Furthermore, the network switching module may be provided with a network data port to access the data flow channel through the network data port. The processor management module 100 may be provided with a network management port to connect to the host computer through the network management port.
[0063] Furthermore, the host computer may be a platform server or a client.
[0064] A data storage device provided in this embodiment can further optimize the data flow channel management and allocation of the data storage device by using the network switching module 300 as the hub between the data flow channel, the processor management module 100 and the intelligent control module 200, thereby improving the flexibility and efficiency of the system, thereby achieving the effect of improving data storage capacity and reducing device power consumption.
[0065] In one embodiment, the hard disk status information includes at least one of the number of hard disk slots, hard disk slots, and hard disk capacity; and the processor management module is further configured to: Determine a first processable channel threshold of each intelligent control module based on at least one of the number of disk slots, the hard disk slots, and the hard disk capacity; Based on the first processable channel threshold and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
[0066] In one embodiment, the module performance information includes data access capability and / or data compression capability; the processor management module is further configured to: Determine a second processable channel threshold of each intelligent control module based on the data access capability and / or the data compression capability; Based on the hard disk status information and the second processable channel threshold, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
[0067] In one embodiment, the processor management module is further configured to: Obtaining the working status of each of the intelligent control modules; Based on the hard disk status information and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules in normal working status.
[0068] In one embodiment, The processor management module is also used to: generate a stream data acquisition instruction in response to a read instruction from the host computer; send the stream data acquisition instruction to the intelligent control module corresponding to the read instruction; receive the stream data sent by the intelligent control module; and forward the stream data to the host computer; The intelligent control module is further configured to: in response to the stream data acquisition instruction, send the stream data corresponding to the stream data acquisition instruction in the hard disk to the processor management module.
[0069] In one embodiment, the intelligent control module is connected to the hard disk via a SATA bus, and the intelligent control module is further used for: Pulling data through the data stream channel allocated by the processor management module to obtain stream data; Decoding, intelligently compressing and encoding the stream data in sequence to obtain compressed stream data; The compressed stream data is written into the hard disk.
[0070] In one embodiment, a storage server is provided, wherein the storage server is provided with a data storage device as described in any of the above embodiments.
[0071] The data storage device includes a processor management module and a plurality of intelligent control modules, wherein: The processor management module is respectively connected to the plurality of intelligent control modules; each of the intelligent control modules is respectively connected to at least one hard disk; The processor management module is used to respond to the storage instruction of the host computer and send an information acquisition instruction to each of the intelligent control modules; obtain at least one data flow channel corresponding to the storage instruction, and receive the hard disk status information and module performance information corresponding to each intelligent control module; based on the hard disk status information and module performance information, allocate at least one corresponding data flow channel to each of the intelligent control modules; The intelligent control module is used to send hard disk status information and module performance information to the processor management module based on the information acquisition instruction; receive stream data through the data stream channel allocated by the processor management module, and compress and store the stream data in the hard disk.
[0072] Each module in the above data storage device can be implemented in whole or in part by software, hardware, or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.
[0073] In order to explain the technical solution of the present application in more detail, the present application also provides a detailed embodiment.
[0074] In one embodiment, Figure 5 As shown, a storage server is provided, and further, a distributed intelligent compression storage server is provided, wherein the storage server includes a network switching module, a CPU management module (i.e., a processor management module), an intelligent controller (i.e., an intelligent control module) and a hard disk, wherein the hard disk can be a storage medium hard disk HDD.
[0075] The CPU management module is connected to the host computer through the network management port, and the host computer is a platform server or client. The platform server or client can manage the device or issue tasks through the network port. The CPU management module is also connected to the network switching module through the network, and is connected to the 1st to nth intelligent controllers through the out-of-band management bus 1 to the out-of-band management bus n. Each intelligent controller is connected to one or more hard disks. Exemplarily, intelligent controller 1 is connected to hard disk HDD-1 through SATA / SAS, intelligent controller 2 is connected to hard disk HDD-2 through SATA / SAS, and intelligent controller n is connected to hard disk HDD-n through SATA / SAS. Each intelligent controller is also connected to the network switching module through the network.
[0076] The network switching module is connected to the network data port through the network, and the network data port is connected to a plurality of data stream channels. In this embodiment, the data stream channels include IPC video stream channel 1, IPC video stream channel 2, and IPC video stream channel 3. The data stream channel may also be a channel including other media streams or data streams, and this embodiment does not limit the type and quantity of the data streams.
[0077] When the device is powered on, the intelligent controller obtains hard disk slot information, disk position information, capacity information, etc. through the SATA / SAS bus. For example, how many hard disks are attached to the intelligent controller 1, in which slots, and how much capacity each has; at the same time, this information is reported to the CPU management module through the out-of-band management bus. The CPU management module performs unified slot mapping and unified operation and maintenance management for all hard disks in the device. At the same time, the CPU management module obtains the performance information of the intelligent controller through the out-of-band management bus, such as video access capability (how many channels can be accessed), video compression capability of the intelligent controller, etc., to facilitate the CPU management controller to perform task allocation, scheduling, and load balancing management.
[0078] The platform server sends tasks to the CPU management module through the network management port. Task information includes the number of IPC video channels, video channel IP addresses, etc. After receiving the task, the CPU management module allocates the IPC video stream channel to each intelligent controller and the hard disk managed by the intelligent controller according to the performance, hard disk capacity, quantity and other information of the intelligent controller, thus forming a binding relationship between the IPC video stream channel, the intelligent controller and the hard disk. The binding relationship between video recording and the hard disk is also managed by the CPU management module.
[0079] For the implementation of video storage, the intelligent controller pulls the video stream according to the obtained IPC video stream channel IP address, decodes the pulled video stream first, then intelligently compresses it through AI computing power, encodes the compressed video stream, and then writes the encoded video stream to the hard disk through the SATA / SAS bus for storage.
[0080] For the realization of video playback, the platform sends the playback service to the CPU management module. For example, to play back IPC video channel 1, the CPU management module sends a signal to the intelligent controller 1 through the network switching module. The intelligent controller 1 reads the video stream from the hard disk and forwards it to the platform for decoding and playback.
[0081] Reliability clustering of distributed intelligent compression storage servers: The CPU management module monitors the liveness status of the intelligent controller in real time. When an abnormality is detected in the intelligent controller, the original business of the intelligent controller is dispatched to other intelligent controllers, including the relevant IPC video stream channel and the IP address of the stream. Other intelligent controllers take over the work of stream pulling, decoding, intelligent compression, and encoding to ensure the reliability and continuity of the entire machine business.
[0082] A storage server provided in this embodiment provides a CPU-decentralized intelligent compression storage server solution. Each hard disk or each group of hard disks is equipped with an intelligent controller to form distributed storage nodes. The work of accessing and forwarding a large amount of data is distributed to each intelligent controller node, and the video is compressed and then stored through the intelligent controller. On the one hand, the performance requirements of the CPU are greatly reduced, so that the CPU is no longer a bottleneck for video storage, and the power consumption and cost of the device can be reduced by reducing the CPU specifications; on the other hand, the compression algorithm of the intelligent controller also allows hard disks of the same capacity to store more video data. At the same time, the distributed intelligent compression storage server has a network cluster architecture inside the device, which can realize flexible scheduling of tasks, ensure load balancing, and effectively improve storage reliability.
[0083] In one embodiment, each intelligent controller and the hard disk under the intelligent controller can be installed in the same hard disk box. In the whole device, multiple hard disk box components are inserted, and networked through the network switching module, and task scheduling and management are performed through the CPU management module, so as to realize a distributed multi-disk intelligent compression storage server.
[0084] like Figure 6 As shown, the hard disk box is loaded with a mechanical hard disk and a circuit board, which contains an intelligent controller, namely an AI controller and a control board component. The AI controller includes an AI computing module. At the same time, one side is a SATA female socket, which is interconnected with the hard disk through the SATA bus; the other side is a SATA / SAS male socket, which can be connected to a standard SATA / SAS female socket. The external connection signal is the network signal RGMII, and the video code stream is accessed through the network signal input by the external interface component.
[0085] The storage process is as follows: the external interface accesses the encoded video stream through the network signal RGMII, the AI computing module is responsible for decoding the video stream, and then compressing the stream through a specific compression algorithm. After compression, video encoding is performed. After encoding, the compressed encoded stream is stored in the hard disk through the internal SATA bus.
[0086] Through the setting of the above hard disk box, the physical capacity is assumed to be 10TB, and the actual video stream that can be connected is more than 10TB. In simple terms, a 15TB stream data is compressed to only 9TB and stored in a hard disk with a physical capacity of 10TB, which can effectively improve the efficiency and multiple of video storage, and achieve the effect of improving data storage capacity and reducing device power consumption.
[0087] In one embodiment, a storage server is provided, comprising a data storage device as in any of the above embodiments: The data storage device includes a processor management module and a plurality of intelligent control modules, wherein: The processor management module is respectively connected to the plurality of intelligent control modules; each of the intelligent control modules is respectively connected to at least one hard disk; The processor management module is used to respond to the storage instruction of the host computer and send an information acquisition instruction to each of the intelligent control modules; obtain at least one data flow channel corresponding to the storage instruction, and receive the hard disk status information and module performance information corresponding to each intelligent control module; based on the hard disk status information and module performance information, allocate at least one corresponding data flow channel to each of the intelligent control modules; The intelligent control module is used to send hard disk status information and module performance information to the processor management module based on the information acquisition instruction; receive stream data through the data stream channel allocated by the processor management module, and compress and store the stream data in the hard disk.
[0088] In one embodiment, a computer device is provided. The computer device may be a server, and its internal structure diagram may be as follows: Figure 7 As shown. The computer device includes a processor, a memory and a network interface connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store stream data. The network interface of the computer device is used to communicate with an external terminal through a network connection. When the computer program is executed by the processor, a storage device control method is implemented.
[0089] Those skilled in the art will understand that Figure 7 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.
[0090] In one embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the storage device control method of any of the above embodiments is implemented: In response to a storage instruction of the host computer, obtaining at least one data stream channel corresponding to the storage instruction, and hard disk status information and module performance information corresponding to each intelligent control module; Based on the hard disk status information and module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules, so that the intelligent control module receives stream data through the data stream channel and compresses and stores the stream data in the hard disk.
[0091] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the storage device control method of any of the above embodiments is implemented: In response to a storage instruction of the host computer, obtaining at least one data stream channel corresponding to the storage instruction, and hard disk status information and module performance information corresponding to each intelligent control module; Based on the hard disk status information and module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules, so that the intelligent control module receives stream data through the data stream channel and compresses and stores the stream data in the hard disk.
[0092] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties.
[0093] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in this application can include at least one of non-volatile and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetoresistive random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, etc., but are not limited to this.
[0094] The technical features of the above embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.
[0095] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.
Claims
1. A storage device control method, characterized in that: Applied to a data storage device, the data storage device includes a plurality of intelligent control modules, each of the intelligent control modules is respectively connected to at least one hard disk, and the storage device control method includes: In response to a storage instruction of the host computer, obtaining at least one data stream channel corresponding to the storage instruction, and hard disk status information and module performance information corresponding to each intelligent control module; Based on the hard disk status information and module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules, so that the intelligent control module receives stream data through the data stream channel and compresses and stores the stream data in the hard disk.
2. The storage device control method according to claim 1, characterized in that: The hard disk status information includes at least one of the number of hard disk slots, hard disk slots, and hard disk capacity; and the allocating corresponding at least one data stream channel to each of the intelligent control modules based on the hard disk status information and module performance information includes: Determine a first processable channel threshold of each intelligent control module based on at least one of the number of disk slots, the hard disk slots, and the hard disk capacity; Based on the first processable channel threshold and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
3. The storage device control method according to claim 1, characterized in that: The module performance information includes data access capability and / or data compression capability; the allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information includes: Determine a second processable channel threshold of each intelligent control module based on the data access capability and / or the data compression capability; Based on the hard disk status information and the second processable channel threshold, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
4. The storage device control method according to claim 1, characterized in that: The allocating at least one corresponding data stream channel to each of the intelligent control modules based on the hard disk status information and the module performance information further comprises: Obtaining the working status of each of the intelligent control modules; Based on the hard disk status information and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules in normal working status.
5. The storage device control method according to claim 1, characterized in that: The storage device control method further includes: In response to a read instruction from a host computer, a stream data acquisition instruction is generated; Sending the stream data acquisition instruction to the intelligent control module corresponding to the read instruction; Receiving stream data sent by the intelligent control module; The stream data is forwarded to the host computer.
6. A data storage device, characterized in that: The data storage device includes a processor management module and a plurality of intelligent control modules, wherein: The processor management module is respectively connected to the plurality of intelligent control modules; each of the intelligent control modules is respectively connected to at least one hard disk; The processor management module is used to respond to the storage instruction of the host computer and send an information acquisition instruction to each of the intelligent control modules; obtain at least one data flow channel corresponding to the storage instruction, and receive the hard disk status information and module performance information corresponding to each intelligent control module; based on the hard disk status information and module performance information, allocate at least one corresponding data flow channel to each of the intelligent control modules; The intelligent control module is used to send hard disk status information and module performance information to the processor management module based on the information acquisition instruction; receive stream data through the data stream channel allocated by the processor management module, and compress and store the stream data in the hard disk.
7. The data storage device according to claim 6, characterized in that: The data storage device further comprises a network switching module, the processor management module is connected to the plurality of intelligent control modules via the network switching module, and the network switching module is also connected to a plurality of data flow channels; The processor management module is also used to generate a channel allocation instruction based on the hard disk status information and the module performance information; The network switching module is used to allocate at least one corresponding data flow channel to each of the intelligent control modules based on the channel allocation instruction.
8. The data storage device according to claim 6, characterized in that: The hard disk status information includes at least one of the number of hard disk slots, hard disk slots, and hard disk capacity; the processor management module is also used for: Determine a first processable channel threshold of each intelligent control module based on at least one of the number of disk slots, the hard disk slots, and the hard disk capacity; Based on the first processable channel threshold and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
9. The data storage device according to claim 6, characterized in that: The module performance information includes data access capability and / or data compression capability; the processor management module is also used for: Determine a second processable channel threshold of each intelligent control module based on the data access capability and / or the data compression capability; Based on the hard disk status information and the second processable channel threshold, at least one corresponding data stream channel is allocated to each of the intelligent control modules.
10. The data storage device according to claim 6, characterized in that: The processor management module is also used for: Obtaining the working status of each of the intelligent control modules; Based on the hard disk status information and the module performance information, at least one corresponding data stream channel is allocated to each of the intelligent control modules in normal working status.
11. The data storage device according to claim 6, characterized in that: The processor management module is also used to: generate a stream data acquisition instruction in response to a read instruction from the host computer; send the stream data acquisition instruction to the intelligent control module corresponding to the read instruction; receive the stream data sent by the intelligent control module; and forward the stream data to the host computer; The intelligent control module is further configured to: in response to the stream data acquisition instruction, send the stream data corresponding to the stream data acquisition instruction in the hard disk to the processor management module.
12. The data storage device according to claim 6, characterized in that: The intelligent control module is connected to the hard disk via a SATA bus, and the intelligent control module is also used for: Pulling data through the data stream channel allocated by the processor management module to obtain stream data; Decoding, intelligently compressing and encoding the stream data in sequence to obtain compressed stream data; The compressed stream data is written into the hard disk.
13. A storage server, characterized in that: The storage server is provided with a data storage device as claimed in any one of claims 6 to 12.
14. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the method according to any one of claims 1 to 5 is implemented.
15. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 5 is implemented.
Citation Information
Patent Citations
Control device for data storage system
CN106951181A
Method for processing data, storage apparatus, solid state disk and storage system
CN109690681A
Hard disk management method and device, electronic equipment and storage medium
CN112198949A
Data operation method and device, equipment and medium
CN113885798A
Field programmable gate array (FPGA)-based disk data read-write control method and device and storage terminal
CN115269455A