217 results about "Disk space" patented technology

The invention discloses a small file distributed high-concurrency aggregation storage method and system, and the method comprises the steps: collecting performance index data, and transmitting the data to a resource coordination server; calculating a queuing rate; determining a target server according to the queuing rate, the file reading concurrency and the disk residual space; determining a first-level directory hash value; selecting a first-level storage directory and a second-level storage directory according to the first-level directory hash value; creating a target aggregation file in the secondary storage directory, generating a 2-byte file format field according to the compression identifier or the non-compression identifier, and generating a 4-byte file length field according to the size of the to-be-written file; writing the file format field, the file length field and the to-be-written file into a target aggregation file in sequence, and recording the initial offset of writing; and generating a file name containing the storage position information, and returning the file name to the client. According to the invention, the efficiency and effect of small file storage are optimized.

The invention provides a hard disk testing method, a hard disk fault early warning method and a hard disk fault early warning device, which can be applied to the technical field of storage equipment. The hard disk testing method comprises the following steps: processing a to-be-tested hard disk to enable the to-be-tested hard disk to reach a steady state condition; executing an advanced formatting operation on the to-be-tested hard disk reaching the steady state condition to obtain the to-be-tested hard disk after the advanced formatting operation is completed; based on a plurality of preset overwriting proportions, testing operation is executed on the to-be-tested hard disk after the advanced formatting operation is completed, performance testing data are obtained, and the overwriting proportions are proportions of the overwriting area space in the to-be-tested hard disk space after the advanced formatting operation is completed; according to the performance test data corresponding to the multiple preset overwriting proportions, a performance test result is obtained, and the performance test result represents the performance recovery capability of the to-be-tested hard disk after the advanced formatting operation is completed.

The embodiment of the invention relates to the technical field of data storage, in particular to a data storage method and device, equipment and a storage medium, and aims at improving the data read-write efficiency of distributed storage. The method comprises the following steps: receiving a data writing request sent by a client; performing erasure code calculation on business data corresponding to the data writing request to obtain storage data; through a preset network transmission protocol, the storage data is written into a hard disk space pre-applied from at least one data storage node, and the minimum storage unit of the hard disk space is a data block; and recording a mapping relationship between the business object range corresponding to the storage data and the internal object range in the data storage node in the metadata storage node.

The invention relates to the technical field of wind power plant network operation and maintenance, in particular to a method and related equipment for monitoring alarm information, and the method comprises the steps: inputting basic information of a physical machine and a virtual machine, including an equipment model, an IP address, a deployment position and specified field information; a resource binding threshold value is set, and the resource binding threshold value covers the space utilization rate of a CPU, a memory and a disk; monitoring resource use conditions in real time, performing natural language processing on alarm information, and extracting key features; matching the key features with historical data by using a preset classification model, dividing alarm levels and allocating the alarm levels to corresponding processing queues in combination with a resource threshold exceeding degree; and pushing alarm information to the contact person through a multi-mode notification channel according to the alarm level.

The invention relates to a database technology, in particular to a block incremental backup method based on a shared storage cluster, a product, a medium and equipment. The block incremental backup method comprises the steps that each node of a shared storage cluster independently stores block change information of the node by utilizing a respective mapping file, and the block change information comprises information of a modified data block on the node; when the block incremental backup is executed, based on the block change information of each node, integrating to obtain all modified data blocks; and performing incremental backup processing according to the modified data block to realize block incremental backup. According to the block incremental backup method, only the information of the modified data block is stored through the mapping file, and the block incremental backup is performed based on the block change information, so that the problem of large disk space occupation caused by storage of all data block information is avoided, the disk space occupation is reduced, efficient storage of the block change information is realized, and the storage efficiency is improved. And meanwhile, the backup efficiency is improved, so that the overall performance is improved.

The invention belongs to the technical field of databases, and particularly discloses an index column fusion storage method and system.The method comprises the steps that a target column is determined, the target column is a data column configured with a Pstort index in a column storage table, and the character length of the field type of original data of the target column is larger than that of an index position identifier; the column storage table is a data table adopting a column storage mode, and the index position identifier is used for indicating the position of the original data in the index file; and configuring the field type of the target column as an index position identifier type, so that each row in the target column stores an index position identifier. By means of the method and device, high-performance and high-compression index column data fusion is achieved, and the occupation amount of the data files and the index files in the disk space can be reduced under the condition that the query efficiency is considered.

The present application relates to the technical field of data storage, and discloses a disk array capacity expansion method and apparatus, a storage system, and a product. The method comprises: according to an array chunk size, dividing a newly added hard disk space into a plurality of newly added data chunks, and adding the plurality of newly added data chunks to a disk array; marking all the newly added data chunks as unexpanded data chunks, and keeping the spatial distribution of original data chunks and parity chunks in the disk array unchanged; when data is to be written into an unexpanded data chunk for the first time, generating full-sized chunk data on the basis of data to be written and writing the full-sized chunk data into the unexpanded data chunk, and updating parity data of a stripe to which the data chunks belongs; and after the full-sized chunk data is written into the unexpanded data chunk for the first time, marking the data chunk as an expanded data chunk. The method can avoid a large amount of data migration during disk expansion, speed up a capacity expansion process, and improve the IO request processing performance of a storage system during capacity expansion.

The invention provides a data processing method and a related device, which can be applied to a database flash-back scene. The method comprises the steps of receiving a first flashback instruction, and recording a first page to a flashback log before the first page in a database is modified for the first time in a target period in response to the first flashback instruction. And receiving a second flash-back instruction, and in response to the second flash-back instruction, restoring the database to a state at a specified moment based on the flash-back log and the redo log of the database. In the application, the first page is recorded in the flash-back log only before the first page is modified for the first time in the target period. In other words, for the first page with the modification operation, only one initial page is recorded in the target period, and the subsequent modification version in the target period is not recorded, so that the overhead of the disk space can be effectively reduced.

Managing resources in a VM cluster; allocation of resources among competing VMs. Assigning VMs to real devices, responsive to needs for resources: processor usage, disk I / O, network I / O, memory space, disk space. Assigning VMs responsive to needs for cluster activity: network response latency, QoS. Using predictive models of resource usage by VMs. Transferring VMs, improving utilization. Failing-soft onto alternative VM resources. Providing a resource buffer for collective VM resource demand. Transferring VMs to a cloud service that charges for resources.

One or more embodiments in the present description relate to the technical field of databases. Provided are a data processing method and apparatus. The method is applied to a database based on a combination of a log structure and a tree storage structure. In the solution provided in the present description, the method comprises: acquiring the volume of data to be deleted recorded in an incremental sorted string table (SSTable) of a target partition; and if the volume of said data recorded in the incremental SSTable reaches a first volume threshold value, combining the incremental SSTable into a baseline SSTable of the target partition, so as to delete said data. By means of the solution provided in the present description, data to be deleted can be deleted from a target partition in a timely manner, thereby optimizing the query performance of a database, and reducing unnecessary occupancy of a disk space by said data.

The invention discloses a file lock management method and device for a distributed file system, equipment and a medium, and is applied to the technical field of computers, and the method comprises the following steps: after receiving a first file access request initiated by a client to a first access node, constructing first file lock information according to an identification parameter in the access request, persistently storing the first file lock information to a shared disk space and caching the first file lock information to a local first access node; the access node is a mounting node for the client to access the distributed file system; switching the mounting node from the first access node to a second access node, and clearing the first file lock information locally cached by the first access node; and after a second file access request initiated by the client to the second access node is received, querying the first file lock information in the shared disk space based on the identification parameter in the access request so as to locally reconstruct the file lock cache at the second access node. According to the method and the device, the problem of file lock loss and residue in a distributed cluster access node switching scene is solved.

The invention provides a file processing method and device, and the method comprises the steps: calculating a Hash value corresponding to a first file, judging whether a second file exists in a pre-created first global Hash index directory or not according to the Hash value corresponding to the first file, and if the second file exists in the first global Hash index directory, determining that the second file exists in the first global Hash index directory; if yes, replacing the first file with the hard link of the second file; and / or obtaining a hash value corresponding to the third file, judging whether a fourth file exists in a pre-created second global hash index directory or not according to the hash value corresponding to the third file, if the fourth file exists in the second global hash index directory, creating the third file, and performing hard linking on the third file to the fourth file, so that the disk space can be saved; and the realization is simpler.

The invention belongs to the technical field of space management, and discloses a virtual disk space management method and system based on block reconstruction. Comprising the steps of obtaining real-time block state data of a qcow2 mirror image in a virtual machine operation environment, and performing candidate block extraction and bidirectional state comparison matrix construction according to the real-time block state data; calculating a void confidence score of each candidate block according to the bidirectional state comparison matrix in combination with the real-time block state data; performing hierarchical sorting and continuous block address field screening according to the void confidence score to obtain a to-be-reconstructed void section; the qcow2 mirror image is divided into a plurality of reconstruction units, a micro-granularity read-write lock is applied for the reconstruction units containing to-be-reconstructed cavity segments, cavity punching operation is executed after the read-write lock is obtained, and L2 mapping table entries are synchronously updated; the I / O request delay change rate of the virtual machine is monitored in real time, and the execution rate of the block reconstruction operation is dynamically adjusted based on the I / O request delay change rate; the storage resource utilization rate and the service stability of the virtual machine are improved.

The present application relates to a dynamic file mounting method, system, computer device, and readable storage medium. The method comprises: invoking a proxy device to create n Samba users associated with a virtual machine, each Samba user being configured with corresponding user information; sending file mounting information associated with the virtual machine to the proxy device; and upon receiving the file mounting information, creating a virtual machine mounting directory based on the file mounting information and linking the file to be mounted to the corresponding virtual machine mounting directory. This application solves the problems of prolonged virtual machine creation time when copying large files, and the waste of disk space caused by repeated copying of the same file by different virtual machines. Dynamic mounting is achieved, and the creation time of large file mounting is shortened, while significantly saving disk space.

The invention discloses a data processing method, device and equipment and a readable storage medium, and the method comprises the steps: setting the state of a logic disk through employing a logic disk operation request sent by a host, and determining a corresponding authentication code and an encryption code under the condition that the encryption and decryption functions of the logic disk are enabled; receiving a data writing request sent by the host, and determining a target logic disk corresponding to the writing position and target data to be written; authenticating the data writing request by using the authentication code of the target logic disk; under the condition that the authentication is passed and the current state of the target logic disk is encryption and decryption starting, encrypting the target data by using an encryption code of the target logic disk to obtain target encrypted data; and writing the target encrypted data into a hard disk space having a mapping relationship with the target logic disk in the redundant array of independent disks. According to the method and the device, the reliability and the security of data stored on the hard disk without an encryption function can be ensured.

The embodiment of the invention provides a data access method and device, a storage medium and electronic device.The data access method comprises the steps that container service is started in each controller, and a metadata service component and a file sharing protocol service component are added in a container mirror image managed by each container service, each controller is a controller in a disk array; under the condition that a data access request sent by target equipment is received, accessing target file data through a first container service in a first controller and a first block service in the first controller, the first container service and the first block service perform data interaction through a first shared memory in the first controller, and the data access request is a request for accessing target file data corresponding to a first disk space managed by the first controller.

Third party applications are deployed as “containerized applications” on one or more wireless AP devices. The containerized applications are confined to a pre-allocated segregated disk space within a file system of a wireless AP device. The containerized applications have access to standard Linux services as well as access to advanced features provided by an AP.

The invention discloses a data secrecy method and device based on permission sharing operation of an encrypted PSSD and a medium. The method comprises the following steps: 1) performing permission partitioning on the PSSD; 2) setting an encryption area feature attribute; an attribute structure Lij is set for each encryption area, and accessible user groups and corresponding lowest user permissions of the encryption areas are specified in the structure; 3) allocating unlocking permissions to each group of users; 3) when a request of accessing the encryption area by the user is received, performing access permission verification on the user; and 4) if the identity authority level of the user executing unlocking currently is greater than the encrypted disk partition authority and the accessible user group is matched, automatically unlocking the disk space with the matched authority, otherwise, sending verification failure information, and recording error counting for each verification failure. According to the method, stepped data sharing and management of personnel among the groups can be achieved, reading and writing of data among the groups are achieved according to user permission, and disk encryption space can be managed more flexibly.

The invention belongs to the technical field of computer storage, and particularly discloses an encryption difference compressed data restoration method and device based on similarity perception. According to the method and the device, the differential data block and the reference block which are subjected to aggregation storage are read from the continuous disk space at one time; in the data recovery process, pipelining processing is carried out on a difference decoding task and an erasure code decoding task; and performing data restoration according to the size of the data slice, the difference data block and the reference block by executing the pipelined difference decoding task and the pipelined erasure code decoding task. According to the mode, the whole aggregation storage data block containing the differential data block and the reference block is read from the continuous disk space, compared with respective reading, one-time extra disk overhead can be reduced, then the differential decoding task and the erasure code decoding task are subjected to pipelining processing, and the decoding efficiency is improved. And data recovery is carried out by executing the decoding task, so that the data recovery performance of the encryption difference compression system can be effectively improved.

The invention relates to the field of data access, and particularly provides an MPT-based block chain database system, a data access method, a terminal and a medium, the system comprises a native MPT storage engine used for realizing an MPT node structure in a disk and a memory, and the node structure comprises branch nodes, extension nodes and leaf nodes; the asynchronous I / O module is used for realizing non-blocking disk operation based on Linux iouring; the file system bypass module is used for supporting direct access to the block device; the versioning concurrency control module is used for realizing lock-free reading through an immutable Trie structure and atomic pointer updating; and the dynamic compression module is used for dynamically adjusting a historical data retention strategy according to the disk space utilization rate. The MPT structure storage engine is realized, basic data support is provided for a high-performance block chain system, serialization overhead is eliminated, and storage efficiency is improved.

The application discloses a mirror backup method and device, electronic equipment and a computer readable storage medium. The method comprises the following steps: starting a mirror warehouse service, and constructing a node local warehouse; acquiring a node label, acquiring a node mirror corresponding to the node label from a complete mirror warehouse, and saving the node mirror to the node local warehouse; if it is detected that polling backup of a target mirror is required, acquiring the target mirror from the complete mirror warehouse, and saving the target mirror to the node local warehouse; the target mirror is a mirror which does not exist in the node local warehouse and the number of backup is less than two; the method adopts a non-consistent distributed backup mechanism to backup the mirror, all the mirrors have at least two backups in the cluster, when any node is abnormal, all the mirrors in the cluster can be guaranteed, the high availability of the cluster is guaranteed, and the bandwidth and disk space occupied by mirror transmission and storage can be reduced.

The invention discloses an overlay-based traceless data cleaning method, which comprises the following steps of: after a file system is loaded when a system is started, creating an overlay file system, and overlapping and mounting contents of a root directory into the overlay file system according to a data protection partition range set by a user; data generated in the process of using the operating system by the user is stored in the overlay file system; and when data cleaning is needed, calling shred to perform physical layer deep cleaning on all data in the overlay file system. According to the method, the disk space does not need to be wasted for backup in advance, the file is backed up only when the file is changed, the disk space consumption is small (only the changed file is backed up), and the implementation (cleaning and restoring) time is short.

The application discloses a resource prediction method and device, equipment and a readable storage medium, which can be applied to the field of artificial intelligence technology, and the method comprises the steps of obtaining metadata corresponding to a target task; based on the metadata, a preset task classification tree is used to classify the target task, and a target classification result is obtained; a corresponding relationship between different types of tasks and different resource prediction models is stored in the preset task classification tree; a resource prediction model corresponding to the target classification result is called to predict the resources of the target task, and a prediction target data is obtained; the prediction target data comprises the number of CPUs, the number of GPUs, the size of memory and the disk space. In this way, the resource prediction model corresponding to the target task is determined based on the preset task classification tree, and then the resources are predicted, thereby improving the accuracy of resource prediction.

The application discloses a GC mechanism processing method and device and medium, and is suitable for the technical field of solid state disks. When the RGW service is started, a GC main thread, a queue and a work thread are created, wherein the GC main thread starts the GC mechanism; garbage data obtained by the GC main thread traversing a storage pool is stored in the queue; and the queue sends the garbage data to the work thread in a de-queue mode so that the work thread deletes the garbage data. The method uses the thread division mode, the GC main thread starts the GC mechanism, when the GC mechanism is started, garbage collection is processed, the main thread is responsible for traversing the garbage data, and the work thread deletes the garbage data, thereby effectively improving the processing speed of the GC mechanism, relieving the pressure of only executing garbage collection through a single thread at present, and guaranteeing the stability of the system. Meanwhile, the multiple threads execute the deletion of the garbage data, high concurrency is realized, and available disk space is released.

A novel software updating method is provided. A target file is divided into segments, where some segments are updated by patching, while other segments are updated by archiving. The segmentation of the update allows very large files such as DYLD shared caches to be patched in-place, i.e., by using free space available within the file to perform patching rather than requiring enough free space on disk to store both the new version and the old version of the file. The segmentation of the update also allows each segment to be updated individually by the most optimal update method (copy, patch, or archive) so that the size of the update file can be minimized.

The invention provides a method and device for restoring factory settings and electronic device.The method comprises the steps that when a factory setting restoring request is received, a white list in a target disk and root folder nodes corresponding to objects in the white list are obtained; modifying the root folder node into a preset folder node in a mapping modification mode, wherein a disk space mapped by the root folder node before modification is consistent with a disk space mapped by the preset folder node after modification; and formatting disk space files corresponding to other nodes except the preset folder node in the target disk. According to the method, copying and pasting type backup does not need to be carried out on the object in an actual physical storage system, so that an input and output process of a disk does not exist.

The application discloses a data backup system and method, a storage medium and an electronic device, and relates to the field of financial technology. The system comprises: a ledger database, which is used to acquire information of a database group and generate a backup strategy corresponding to the database group; a backup management platform, which is used to acquire the backup strategy, execute a backup task of the database group through a backup database in the case that a backup mode is remote backup, and backup data generated by the backup task to a distributed object storage system; and the distributed object storage system, which is used to receive the data generated by the backup task. Through the application, the problems of large occupation of built-in SSD storage disk space by backup data and difficult management of backup data in the related art are solved.

An Oracle database big table data deletion method with small disk space occupation comprises the following steps: firstly, selecting a data table to be deleted in an Oracle database, and then carrying out paging query to obtain data of each page; the method comprises the following steps: firstly, screening data of each page to obtain data meeting conditions, then carrying out deletion operation, monitoring execution time of the deletion operation, if the deletion operation is completed within a preset time threshold, continuing to process data of a next page, and if the deletion operation is overtime, checking whether deadlock occurs or not; if the deadlock exists, terminating the deletion operation of the current page, waiting for a preset time length, and then performing the deletion operation of the current page; if the deadlock does not exist, skipping the current page, and continuing to delete the data of the next page; and repeating the above steps on other target data tables in the Oracle database in sequence to perform data deletion until all the data meeting the conditions are deleted, and ending the method. When a large amount of data is deleted, the efficiency is high.

A method and system for leveraging file-system metadata for direct to cloud object storage optimization. Under cloud object storage architecture, any unstructured data may be managed and stored in the cloud as objects. Objects thus provide an elastic, scalable format through which unstructured data may be maintained for a variety of purposes, including those directed to data backup, archiving, and / or disaster recovery. Cloud object storage, however, tends to be costly—mainly stemming from factors, such as the frequency of read and write operations (also referred to as runtime costs) applied to, as well as the allocation of disk space (also referred to as storage costs) consumed by, any number of objects configured to store file backup copies. In addressing at least the aforementioned, embodiments disclosed herein optimize cloud object storage utilization through the intelligent grouping and object storing of data based on file attribute similarities.

The invention provides a transaction log processing method of a database, a storage medium and equipment. The transaction log processing method of the database comprises the following steps: obtaining a trigger event of successfully creating a check point by the database; checking a basic backup of the database and a state of a transaction log of the database, wherein page mirror data in the transaction log is independently stored in a preset page data table; determining whether the basic backup has been backed up to a state in which all the transaction logs exist; and if yes, cleaning the page data table according to the application scene of the database. According to the scheme, the disk space occupied by the page data table used for storing the page mirror image data can be greatly reduced on the premise that the data security of the database is guaranteed.