299 results about "Disk space" patented technology

The invention discloses a small file distributed high-concurrency aggregation storage method and system, and the method comprises the steps: collecting performance index data, and transmitting the data to a resource coordination server; calculating a queuing rate; determining a target server according to the queuing rate, the file reading concurrency and the disk residual space; determining a first-level directory hash value; selecting a first-level storage directory and a second-level storage directory according to the first-level directory hash value; creating a target aggregation file in the secondary storage directory, generating a 2-byte file format field according to the compression identifier or the non-compression identifier, and generating a 4-byte file length field according to the size of the to-be-written file; writing the file format field, the file length field and the to-be-written file into a target aggregation file in sequence, and recording the initial offset of writing; and generating a file name containing the storage position information, and returning the file name to the client. According to the invention, the efficiency and effect of small file storage are optimized.

The invention provides a hard disk testing method, a hard disk fault early warning method and a hard disk fault early warning device, which can be applied to the technical field of storage equipment. The hard disk testing method comprises the following steps: processing a to-be-tested hard disk to enable the to-be-tested hard disk to reach a steady state condition; executing an advanced formatting operation on the to-be-tested hard disk reaching the steady state condition to obtain the to-be-tested hard disk after the advanced formatting operation is completed; based on a plurality of preset overwriting proportions, testing operation is executed on the to-be-tested hard disk after the advanced formatting operation is completed, performance testing data are obtained, and the overwriting proportions are proportions of the overwriting area space in the to-be-tested hard disk space after the advanced formatting operation is completed; according to the performance test data corresponding to the multiple preset overwriting proportions, a performance test result is obtained, and the performance test result represents the performance recovery capability of the to-be-tested hard disk after the advanced formatting operation is completed.

The invention provides a high-performance bare disk management method, which comprises the following steps of: dividing a disk space into a user data area and a metadata area, dividing the user data area into a plurality of fragments, and positioning metadata information of the fragments in the metadata area; a user module is responsible for maintaining the mapping relation between data and a data block management unit and the mapping relation between the data block management unit and a fragment ID, and sending an I / O request to a fragment control module; disk control is executed through a fragmentation control module, the fragmentation control module is of a multi-layer structure, and each layer executes corresponding control operation; wherein the disk control comprises disk space management, data consistency control and I / O operation, and the data consistency control is executed through a clock mechanism. The method has the beneficial effects that the management efficiency is improved, metadata operation is reduced, kernel interaction is reduced, the software performance is improved, and the single-disk performance bottleneck caused by a CPU (Central Processing Unit) is avoided.

The embodiment of the invention provides a disk space management method and device, equipment and a storage medium. The method comprises the steps of obtaining storage space use information corresponding to a database, wherein the storage space use information at least indicates a storage space occupancy rate of the database in a corresponding target disk; using a trained demand prediction model corresponding to the database to determine a demand prediction result corresponding to the database based on the storage space usage information, the demand prediction result indicating a storage space demand of the database for the target disk; based on the storage space usage information and / or the demand prediction result, disk optimization operation on the target disk is executed, and the disk optimization operation comprises clearing operation for log files and / or data table space fragments in the target disk and / or disk space updating operation for the database. Therefore, by monitoring and analyzing the use condition of the disk space, the disk optimization operation is adjusted, and the efficiency of database disk space management is improved.

The embodiment of the invention relates to the technical field of data storage, in particular to a data storage method and device, equipment and a storage medium, and aims at improving the data read-write efficiency of distributed storage. The method comprises the following steps: receiving a data writing request sent by a client; performing erasure code calculation on business data corresponding to the data writing request to obtain storage data; through a preset network transmission protocol, the storage data is written into a hard disk space pre-applied from at least one data storage node, and the minimum storage unit of the hard disk space is a data block; and recording a mapping relationship between the business object range corresponding to the storage data and the internal object range in the data storage node in the metadata storage node.

The invention relates to the technical field of wind power plant network operation and maintenance, in particular to a method and related equipment for monitoring alarm information, and the method comprises the steps: inputting basic information of a physical machine and a virtual machine, including an equipment model, an IP address, a deployment position and specified field information; a resource binding threshold value is set, and the resource binding threshold value covers the space utilization rate of a CPU, a memory and a disk; monitoring resource use conditions in real time, performing natural language processing on alarm information, and extracting key features; matching the key features with historical data by using a preset classification model, dividing alarm levels and allocating the alarm levels to corresponding processing queues in combination with a resource threshold exceeding degree; and pushing alarm information to the contact person through a multi-mode notification channel according to the alarm level.

The invention discloses a disk space distribution method and device, electronic equipment and a computer readable storage medium. The disk space distribution method comprises the steps that address information of at least one target free space block in the same disk is acquired; setting the lowest address in the obtained address information to a root node of the binary heap, and setting other obtained address information in the binary heap according to a principle that an address indicated by any father node in the binary heap is lower than an address indicated by a child node; the target free space blocks are allocated based on the binary heap, the target free space blocks corresponding to the addresses set by the root nodes are always allocated in each allocation, and the target free space blocks are allocated according to the principle that the root nodes in the binary heap indicate the lowest address and the address indicated by any father node in the binary heap is lower than the address indicated by the child nodes after allocation. And updating the address indicated by each node in the binary heap. The overall read-write speed of the storage system can be improved.

The invention relates to the technical field of data processing, and particularly discloses a distributed data processing method which comprises the steps of establishing a distributed node network, monitoring node states, analyzing node operation loads, judging node load states, judging data processing priorities, distributing data processing tasks and optimizing distributed processing nodes. A distributed node network is established, an area covered by a data processing system is divided into a plurality of processing areas, and running state parameters of nodes on servers in the processing areas are monitored in real time and comprise the CPU utilization rate, the memory utilization rate, the network bandwidth occupancy rate and the disk space utilization rate. According to the method, the fault or performance problem of the node can be found and processed in time, and meanwhile, through a refined task allocation and node optimization strategy, each server resource in the distributed processing area can be efficiently utilized to a great extent, so that the priority processing of a core task and the stable operation of the overall system are ensured.

The invention relates to a database technology, in particular to a block incremental backup method based on a shared storage cluster, a product, a medium and equipment. The block incremental backup method comprises the steps that each node of a shared storage cluster independently stores block change information of the node by utilizing a respective mapping file, and the block change information comprises information of a modified data block on the node; when the block incremental backup is executed, based on the block change information of each node, integrating to obtain all modified data blocks; and performing incremental backup processing according to the modified data block to realize block incremental backup. According to the block incremental backup method, only the information of the modified data block is stored through the mapping file, and the block incremental backup is performed based on the block change information, so that the problem of large disk space occupation caused by storage of all data block information is avoided, the disk space occupation is reduced, efficient storage of the block change information is realized, and the storage efficiency is improved. And meanwhile, the backup efficiency is improved, so that the overall performance is improved.

The invention belongs to the technical field of databases, and particularly discloses an index column fusion storage method and system.The method comprises the steps that a target column is determined, the target column is a data column configured with a Pstort index in a column storage table, and the character length of the field type of original data of the target column is larger than that of an index position identifier; the column storage table is a data table adopting a column storage mode, and the index position identifier is used for indicating the position of the original data in the index file; and configuring the field type of the target column as an index position identifier type, so that each row in the target column stores an index position identifier. By means of the method and device, high-performance and high-compression index column data fusion is achieved, and the occupation amount of the data files and the index files in the disk space can be reduced under the condition that the query efficiency is considered.

The invention discloses a log output method and device, a readable storage medium and a program product, and relates to the technical field of computer application, and the method comprises the following steps: obtaining a currently set log output level; when it is monitored that the log is generated, the log information level of the currently generated log is obtained; when the log information level is an error level and the log output level is a non-debugging level, brushing pre-cached log information containing at least one level from a log cache; and adjusting the log output level to a debugging level so as to record debugging log information generated after the log is currently generated. By applying the log output method provided by the invention, the host disk space is saved, the time and labor cost is reduced, and the influence on the program service performance is reduced.

The present application relates to the technical field of data storage, and discloses a disk array capacity expansion method and apparatus, a storage system, and a product. The method comprises: according to an array chunk size, dividing a newly added hard disk space into a plurality of newly added data chunks, and adding the plurality of newly added data chunks to a disk array; marking all the newly added data chunks as unexpanded data chunks, and keeping the spatial distribution of original data chunks and parity chunks in the disk array unchanged; when data is to be written into an unexpanded data chunk for the first time, generating full-sized chunk data on the basis of data to be written and writing the full-sized chunk data into the unexpanded data chunk, and updating parity data of a stripe to which the data chunks belongs; and after the full-sized chunk data is written into the unexpanded data chunk for the first time, marking the data chunk as an expanded data chunk. The method can avoid a large amount of data migration during disk expansion, speed up a capacity expansion process, and improve the IO request processing performance of a storage system during capacity expansion.

The invention discloses a static partition data migration method and system for a distributed storage system, and the method comprises the steps: dividing a disk of each storage node into an immigrated disk set and an emigrated disk set, determining a data volume threshold value of the disk based on the capacity threshold value of the disk and the current water level line, and determining whether the disk is an immigrated disk or an emigrated disk according to the data volume threshold value and the current load capacity of the disk, so as to obtain an immigrated disk set and an emigrated disk set, the current water level is determined based on the current load of the disk participating in the water level updating; and determining a migration plan of the distributed storage system based on the immigrated disk set and the emigrated disk set. According to the method and the device, disk data migration can be better determined in a scene of nonuniform disk capacity, and the situation of insufficient disk space during actual migration is avoided.

The invention discloses a disk space management method and device, electronic equipment and a storage medium, and the method comprises the steps that a linked list is configured for a to-be-managed storage space, and the linked list is formed by sequentially connecting a starting node, a plurality of intermediate nodes and an end node in series; forming a one-to-one correspondence relationship between all intermediate node sequences of the linked list and a vacant unit sequence; wherein the vacant unit sequence is formed by sequentially connecting all vacant storage units in the storage space in series according to the relative position relation of the vacant storage units; in response to the change of the vacant storage units in the storage space, the composition of the intermediate nodes of the linked list is changed, so that the sequence of the intermediate nodes of the linked list is always kept in one-to-one correspondence with the sequence of the real-time vacant units in the storage space. The technical problems that in the prior art, the processing speed is limited due to the fact that data management is conducted through a single-layer bitmap, and the query performance is affected due to the fact that data management is conducted through a multi-layer bitmap are solved.

The invention discloses a frame rate adjusting method, which is characterized in that an NVR (Network Video Recorder) is driven by an event, and adaptively adjusts the frame rate of each IPC according to the event content of each IPC so as to adjust a code stream, and specifically comprises the following steps: when an IPC is triggered by the event, adjusting the frame rate of the IPC according to the current bandwidth and the equipment parameters of the IPC, and reducing the frame rates of other IPCs which are not triggered by the event for a long time; the video quality is improved by adaptively reducing the frame rate of the IPC when no event is triggered and improving the frame rate when the event is triggered, so that the network bandwidth and the hard disk space are saved, each IPC runs at a lower frame rate when no event is triggered, more IPCs can be accessed to the NVR on the basis of the original maximum bandwidth, and the monitoring quality and the maintenance cost are balanced.

The invention provides a data processing method and a related device, which can be applied to a database flash-back scene. The method comprises the steps of receiving a first flashback instruction, and recording a first page to a flashback log before the first page in a database is modified for the first time in a target period in response to the first flashback instruction. And receiving a second flash-back instruction, and in response to the second flash-back instruction, restoring the database to a state at a specified moment based on the flash-back log and the redo log of the database. In the application, the first page is recorded in the flash-back log only before the first page is modified for the first time in the target period. In other words, for the first page with the modification operation, only one initial page is recorded in the target period, and the subsequent modification version in the target period is not recorded, so that the overhead of the disk space can be effectively reduced.

The embodiment of the invention provides a disk data backup method, device and equipment. The method can be used in the cloud computing field. The method comprises the steps of determining a current moment as an updating moment according to preset updating cycle setting, and obtaining a directory list recording file and a file list recording file; obtaining a plurality of catalogs needing to be synchronized from the source data disk, determining a target catalog needing to be synchronized currently by using the catalog list record file, and backing up the target catalog in the target data disk; obtaining respective second file information of a plurality of second files from a directory needing to be synchronized in the source data disk, for each second file, determining backup information of the second file to a target data disk by utilizing a file list recording file, and if the second file needs to be backed up, backing up the second file to the target data disk; and updating the directory list recording file and the file list recording file. The method is used for achieving the effect of efficiently backing up the disk data while fully utilizing the disk space.

The invention discloses a resource data rendering method and device, a storage medium and electronic equipment. The method comprises the following steps: rendering target resource data in each rendering scene to obtain all pipeline state objects generated by the target resource data; compiling all the pipeline state objects into a hard disk space of the terminal equipment, and storing the pipeline state objects according to the rendering level allocated to each pipeline state object in all the pipeline state objects; obtaining a target rendering request triggered for the target resource data; in response to the target rendering request, reading a target pipeline state object matched with the target rendering level from a hard disk space, and loading the target pipeline state object into a memory space of the terminal device for caching; and reading the target pipeline state object from the memory space, and performing rendering of the target rendering level on the target resource data by using the target pipeline state object. The technical problem that the rendering efficiency of the resource data is low is solved.

Managing resources in a VM cluster; allocation of resources among competing VMs. Assigning VMs to real devices, responsive to needs for resources: processor usage, disk I / O, network I / O, memory space, disk space. Assigning VMs responsive to needs for cluster activity: network response latency, QoS. Using predictive models of resource usage by VMs. Transferring VMs, improving utilization. Failing-soft onto alternative VM resources. Providing a resource buffer for collective VM resource demand. Transferring VMs to a cloud service that charges for resources.

One or more embodiments in the present description relate to the technical field of databases. Provided are a data processing method and apparatus. The method is applied to a database based on a combination of a log structure and a tree storage structure. In the solution provided in the present description, the method comprises: acquiring the volume of data to be deleted recorded in an incremental sorted string table (SSTable) of a target partition; and if the volume of said data recorded in the incremental SSTable reaches a first volume threshold value, combining the incremental SSTable into a baseline SSTable of the target partition, so as to delete said data. By means of the solution provided in the present description, data to be deleted can be deleted from a target partition in a timely manner, thereby optimizing the query performance of a database, and reducing unnecessary occupancy of a disk space by said data.

The invention discloses a file lock management method and device for a distributed file system, equipment and a medium, and is applied to the technical field of computers, and the method comprises the following steps: after receiving a first file access request initiated by a client to a first access node, constructing first file lock information according to an identification parameter in the access request, persistently storing the first file lock information to a shared disk space and caching the first file lock information to a local first access node; the access node is a mounting node for the client to access the distributed file system; switching the mounting node from the first access node to a second access node, and clearing the first file lock information locally cached by the first access node; and after a second file access request initiated by the client to the second access node is received, querying the first file lock information in the shared disk space based on the identification parameter in the access request so as to locally reconstruct the file lock cache at the second access node. According to the method and the device, the problem of file lock loss and residue in a distributed cluster access node switching scene is solved.

The invention provides a file processing method and device, and the method comprises the steps: calculating a Hash value corresponding to a first file, judging whether a second file exists in a pre-created first global Hash index directory or not according to the Hash value corresponding to the first file, and if the second file exists in the first global Hash index directory, determining that the second file exists in the first global Hash index directory; if yes, replacing the first file with the hard link of the second file; and / or obtaining a hash value corresponding to the third file, judging whether a fourth file exists in a pre-created second global hash index directory or not according to the hash value corresponding to the third file, if the fourth file exists in the second global hash index directory, creating the third file, and performing hard linking on the third file to the fourth file, so that the disk space can be saved; and the realization is simpler.

The invention provides a data management method based on a B + tree and electronic equipment. Relates to the technical field of data processing. The method comprises the following steps: in response to a first write operation on node data of a B + tree, writing the node data into an original page of a disk; in response to a first write operation on a target entry in the original page, creating a first increment record in the increment page based on the original page; the first increment record is used for recording first data corresponding to the first write operation, and a first pointer of the target entry indicates first address information of the first increment record; in response to a second write operation on the target entry, creating a second increment record in the increment page; the second incremental record is used for recording second data corresponding to the second write operation; the first pointer of the target entry indicates the second address information of the second increment record, and the second pointer of the second increment record indicates the first address information of the first increment record; according to the embodiment of the invention, disk space waste and read-write complexity can be reduced.

The invention belongs to the technical field of space management, and discloses a virtual disk space management method and system based on block reconstruction. Comprising the steps of obtaining real-time block state data of a qcow2 mirror image in a virtual machine operation environment, and performing candidate block extraction and bidirectional state comparison matrix construction according to the real-time block state data; calculating a void confidence score of each candidate block according to the bidirectional state comparison matrix in combination with the real-time block state data; performing hierarchical sorting and continuous block address field screening according to the void confidence score to obtain a to-be-reconstructed void section; the qcow2 mirror image is divided into a plurality of reconstruction units, a micro-granularity read-write lock is applied for the reconstruction units containing to-be-reconstructed cavity segments, cavity punching operation is executed after the read-write lock is obtained, and L2 mapping table entries are synchronously updated; the I / O request delay change rate of the virtual machine is monitored in real time, and the execution rate of the block reconstruction operation is dynamically adjusted based on the I / O request delay change rate; the storage resource utilization rate and the service stability of the virtual machine are improved.

A spinnable disk spatial filter for a confocal microscope comprises a plurality of semi-annular sections, each semi-annular section shaped to define a corresponding section pinhole group comprising a plurality of pinholes arranged in a lattice pattern, each pinhole permitting transmission of light through the disk. For each semi-annular section, the corresponding section pinhole group is located to have a corresponding section offset along a section offset direction orthogonal to the spinning axis and having at least a component that extends radially from the spinning axis. The section offset is different for at least two of the plurality of semi-annular sections.

The present invention discloses a method for efficiently caching historical data in an offline state of an Internet of Things data collection gateway, including a deployment relationship of the Internet of Things data collection gateway, which includes field instruments, the Internet of Things data collection gateway, and a cloud server. The data of the field instruments are collected by the Internet of Things data collection gateway and temporarily stored inside the Internet of Things data collection gateway, and the data is uploaded to the cloud server through communication methods such as network transmission; users do not need to care about the size of memory and disk space, the cache engine storage efficiency is not high, resulting in a small amount of cached data, and the disk will be full in a long-term offline state.

The present application relates to a dynamic file mounting method, system, computer device, and readable storage medium. The method comprises: invoking a proxy device to create n Samba users associated with a virtual machine, each Samba user being configured with corresponding user information; sending file mounting information associated with the virtual machine to the proxy device; and upon receiving the file mounting information, creating a virtual machine mounting directory based on the file mounting information and linking the file to be mounted to the corresponding virtual machine mounting directory. This application solves the problems of prolonged virtual machine creation time when copying large files, and the waste of disk space caused by repeated copying of the same file by different virtual machines. Dynamic mounting is achieved, and the creation time of large file mounting is shortened, while significantly saving disk space.

The invention discloses a data processing method, device and equipment and a readable storage medium, and the method comprises the steps: setting the state of a logic disk through employing a logic disk operation request sent by a host, and determining a corresponding authentication code and an encryption code under the condition that the encryption and decryption functions of the logic disk are enabled; receiving a data writing request sent by the host, and determining a target logic disk corresponding to the writing position and target data to be written; authenticating the data writing request by using the authentication code of the target logic disk; under the condition that the authentication is passed and the current state of the target logic disk is encryption and decryption starting, encrypting the target data by using an encryption code of the target logic disk to obtain target encrypted data; and writing the target encrypted data into a hard disk space having a mapping relationship with the target logic disk in the redundant array of independent disks. According to the method and the device, the reliability and the security of data stored on the hard disk without an encryption function can be ensured.

The embodiment of the invention provides a data access method and device, a storage medium and electronic device.The data access method comprises the steps that container service is started in each controller, and a metadata service component and a file sharing protocol service component are added in a container mirror image managed by each container service, each controller is a controller in a disk array; under the condition that a data access request sent by target equipment is received, accessing target file data through a first container service in a first controller and a first block service in the first controller, the first container service and the first block service perform data interaction through a first shared memory in the first controller, and the data access request is a request for accessing target file data corresponding to a first disk space managed by the first controller.

Third party applications are deployed as “containerized applications” on one or more wireless AP devices. The containerized applications are confined to a pre-allocated segregated disk space within a file system of a wireless AP device. The containerized applications have access to standard Linux services as well as access to advanced features provided by an AP.