105 results about "Disk space" patented technology

The invention belongs to the technical field of databases, and particularly discloses an index column fusion storage method and system.The method comprises the steps that a target column is determined, the target column is a data column configured with a Pstort index in a column storage table, and the character length of the field type of original data of the target column is larger than that of an index position identifier; the column storage table is a data table adopting a column storage mode, and the index position identifier is used for indicating the position of the original data in the index file; and configuring the field type of the target column as an index position identifier type, so that each row in the target column stores an index position identifier. By means of the method and device, high-performance and high-compression index column data fusion is achieved, and the occupation amount of the data files and the index files in the disk space can be reduced under the condition that the query efficiency is considered.

Managing resources in a VM cluster; allocation of resources among competing VMs. Assigning VMs to real devices, responsive to needs for resources: processor usage, disk I / O, network I / O, memory space, disk space. Assigning VMs responsive to needs for cluster activity: network response latency, QoS. Using predictive models of resource usage by VMs. Transferring VMs, improving utilization. Failing-soft onto alternative VM resources. Providing a resource buffer for collective VM resource demand. Transferring VMs to a cloud service that charges for resources.

The invention discloses a file lock management method and device for a distributed file system, equipment and a medium, and is applied to the technical field of computers, and the method comprises the following steps: after receiving a first file access request initiated by a client to a first access node, constructing first file lock information according to an identification parameter in the access request, persistently storing the first file lock information to a shared disk space and caching the first file lock information to a local first access node; the access node is a mounting node for the client to access the distributed file system; switching the mounting node from the first access node to a second access node, and clearing the first file lock information locally cached by the first access node; and after a second file access request initiated by the client to the second access node is received, querying the first file lock information in the shared disk space based on the identification parameter in the access request so as to locally reconstruct the file lock cache at the second access node. According to the method and the device, the problem of file lock loss and residue in a distributed cluster access node switching scene is solved.

The invention belongs to the technical field of space management, and discloses a virtual disk space management method and system based on block reconstruction. Comprising the steps of obtaining real-time block state data of a qcow2 mirror image in a virtual machine operation environment, and performing candidate block extraction and bidirectional state comparison matrix construction according to the real-time block state data; calculating a void confidence score of each candidate block according to the bidirectional state comparison matrix in combination with the real-time block state data; performing hierarchical sorting and continuous block address field screening according to the void confidence score to obtain a to-be-reconstructed void section; the qcow2 mirror image is divided into a plurality of reconstruction units, a micro-granularity read-write lock is applied for the reconstruction units containing to-be-reconstructed cavity segments, cavity punching operation is executed after the read-write lock is obtained, and L2 mapping table entries are synchronously updated; the I / O request delay change rate of the virtual machine is monitored in real time, and the execution rate of the block reconstruction operation is dynamically adjusted based on the I / O request delay change rate; the storage resource utilization rate and the service stability of the virtual machine are improved.

Third party applications are deployed as “containerized applications” on one or more wireless AP devices. The containerized applications are confined to a pre-allocated segregated disk space within a file system of a wireless AP device. The containerized applications have access to standard Linux services as well as access to advanced features provided by an AP.

The invention relates to the field of data access, and particularly provides an MPT-based block chain database system, a data access method, a terminal and a medium, the system comprises a native MPT storage engine used for realizing an MPT node structure in a disk and a memory, and the node structure comprises branch nodes, extension nodes and leaf nodes; the asynchronous I / O module is used for realizing non-blocking disk operation based on Linux iouring; the file system bypass module is used for supporting direct access to the block device; the versioning concurrency control module is used for realizing lock-free reading through an immutable Trie structure and atomic pointer updating; and the dynamic compression module is used for dynamically adjusting a historical data retention strategy according to the disk space utilization rate. The MPT structure storage engine is realized, basic data support is provided for a high-performance block chain system, serialization overhead is eliminated, and storage efficiency is improved.

The application discloses a mirror backup method and device, electronic equipment and a computer readable storage medium. The method comprises the following steps: starting a mirror warehouse service, and constructing a node local warehouse; acquiring a node label, acquiring a node mirror corresponding to the node label from a complete mirror warehouse, and saving the node mirror to the node local warehouse; if it is detected that polling backup of a target mirror is required, acquiring the target mirror from the complete mirror warehouse, and saving the target mirror to the node local warehouse; the target mirror is a mirror which does not exist in the node local warehouse and the number of backup is less than two; the method adopts a non-consistent distributed backup mechanism to backup the mirror, all the mirrors have at least two backups in the cluster, when any node is abnormal, all the mirrors in the cluster can be guaranteed, the high availability of the cluster is guaranteed, and the bandwidth and disk space occupied by mirror transmission and storage can be reduced.

The application discloses a resource prediction method and device, equipment and a readable storage medium, which can be applied to the field of artificial intelligence technology, and the method comprises the steps of obtaining metadata corresponding to a target task; based on the metadata, a preset task classification tree is used to classify the target task, and a target classification result is obtained; a corresponding relationship between different types of tasks and different resource prediction models is stored in the preset task classification tree; a resource prediction model corresponding to the target classification result is called to predict the resources of the target task, and a prediction target data is obtained; the prediction target data comprises the number of CPUs, the number of GPUs, the size of memory and the disk space. In this way, the resource prediction model corresponding to the target task is determined based on the preset task classification tree, and then the resources are predicted, thereby improving the accuracy of resource prediction.

The application discloses a GC mechanism processing method and device and medium, and is suitable for the technical field of solid state disks. When the RGW service is started, a GC main thread, a queue and a work thread are created, wherein the GC main thread starts the GC mechanism; garbage data obtained by the GC main thread traversing a storage pool is stored in the queue; and the queue sends the garbage data to the work thread in a de-queue mode so that the work thread deletes the garbage data. The method uses the thread division mode, the GC main thread starts the GC mechanism, when the GC mechanism is started, garbage collection is processed, the main thread is responsible for traversing the garbage data, and the work thread deletes the garbage data, thereby effectively improving the processing speed of the GC mechanism, relieving the pressure of only executing garbage collection through a single thread at present, and guaranteeing the stability of the system. Meanwhile, the multiple threads execute the deletion of the garbage data, high concurrency is realized, and available disk space is released.

A novel software updating method is provided. A target file is divided into segments, where some segments are updated by patching, while other segments are updated by archiving. The segmentation of the update allows very large files such as DYLD shared caches to be patched in-place, i.e., by using free space available within the file to perform patching rather than requiring enough free space on disk to store both the new version and the old version of the file. The segmentation of the update also allows each segment to be updated individually by the most optimal update method (copy, patch, or archive) so that the size of the update file can be minimized.

The application discloses a data backup system and method, a storage medium and an electronic device, and relates to the field of financial technology. The system comprises: a ledger database, which is used to acquire information of a database group and generate a backup strategy corresponding to the database group; a backup management platform, which is used to acquire the backup strategy, execute a backup task of the database group through a backup database in the case that a backup mode is remote backup, and backup data generated by the backup task to a distributed object storage system; and the distributed object storage system, which is used to receive the data generated by the backup task. Through the application, the problems of large occupation of built-in SSD storage disk space by backup data and difficult management of backup data in the related art are solved.

A method and system for leveraging file-system metadata for direct to cloud object storage optimization. Under cloud object storage architecture, any unstructured data may be managed and stored in the cloud as objects. Objects thus provide an elastic, scalable format through which unstructured data may be maintained for a variety of purposes, including those directed to data backup, archiving, and / or disaster recovery. Cloud object storage, however, tends to be costly—mainly stemming from factors, such as the frequency of read and write operations (also referred to as runtime costs) applied to, as well as the allocation of disk space (also referred to as storage costs) consumed by, any number of objects configured to store file backup copies. In addressing at least the aforementioned, embodiments disclosed herein optimize cloud object storage utilization through the intelligent grouping and object storing of data based on file attribute similarities.

The invention provides a host data set space allocation control method, device and equipment, a computer readable storage medium and a computer program product, and can be applied to the technical field of financial science and technology. The method comprises the following steps: receiving a data set creation request; obtaining the maximum distributable space size of a target disk group to which the target disk volume belongs; under the condition that the sum of the size of the first disk space and the size of the second disk space is larger than the maximum distributable space size, adjusting prompt information is generated and output, and the adjusting prompt information comprises at least one of the following information: an adjusting suggestion for the size of the first disk space and / or the size of the second disk space; recommending target alternative disk volume information; and executing corresponding adjustment operation according to confirmation feedback of the user on the adjustment prompt information, and triggering creation of the data set based on the adjusted parameters. According to the scheme, the risks of data set space depletion, job interruption and consequent complex data rollback operation caused by the fact that the secondary distribution requirement cannot be met can be reduced.

This invention discloses a data storage method and device based on a block storage engine. The data storage method includes: dividing a logical block of the block storage engine into multiple first logical units; dividing a second logical unit according to the capacity of the first logical units; dividing the physical disk space into physical mapping units with fixed capacities according to the capacity of the logical blocks; allocating corresponding physical mapping units according to the capacity of the logical blocks and storing physical data in the physical mapping units; forming the physical storage address of the physical data and the metadata corresponding to the physical storage address based on the first address mapping relationship between the logical blocks and the physical mapping units, the second address mapping relationship between the first logical units and the physical mapping units, and the physical address of each physical mapping unit. The data storage method based on the block storage engine provided by this invention effectively reduces the amount of metadata in address mapping in a distributed block storage engine.

The application discloses a disk testing method, device and equipment for a virtual machine environment and a medium. The method comprises the following steps: configuring a test environment according to a test instruction, configuring a corresponding virtual storage space in the disk space of the test environment according to a protocol rule, allocating system resources to the storage unit of the virtual storage space, and mounting the storage unit to the created virtual machine. The virtual machine runs a test script corresponding to the test instruction to perform performance testing on the storage unit and obtain a corresponding test result. Through the above method, the virtual storage space containing multiple independent storage units can be configured, and the non-system resources of the storage unit are allocated. Then, the virtual machine mounting the storage unit executes the test instruction and performs performance testing on the storage unit, thereby improving the efficiency of performance testing on the virtual function of the NVMe disk in the virtual machine environment.

The invention discloses a message storage and query method and system based on multiple levels of detail, a medium and electronic equipment, and the method comprises the steps: storing a message in a memory according to multiple levels of detail, and storing the message in a disk according to multiple levels of detail when the memory occupation exceeds a preset threshold; when the message is stored in the disk, splitting the message into a plurality of files according to timestamps, and storing the message with the same ID in a continuous disk space according to multiple detail levels; when the message is queried, the message is retrieved from the memory according to the query request, and if the message does not exist in the memory, the message is queried from the disk; and when the message in the disk is queried, positioning the position of the message in the disk according to the ID and the multi-level-of-detail level, and reading the message to output a query result. According to the invention, the message is stored in the memory in the form of multiple levels of detail, and when the occupied memory exceeds the set threshold, the message is stored in the disk in the form of multiple levels of detail, so that the memory occupation is low, and the system performance is improved.

The embodiment of the invention provides a hard disk sharing method, device and equipment for a heterogeneous system and a storage medium, and the method comprises the steps that a non-real-time system of the heterogeneous system mounts a virtual hard disk of each real-time system of the heterogeneous system to a corresponding directory of a physical hard disk, and the non-real-time system manages the physical hard disk; any real-time system sends connection request information to the non-real-time system before accessing the virtual hard disk of the real-time system, and after the connection request passes verification of the non-real-time system, the real-time system performs access operation on the virtual hard disk of the real-time system. According to the technical scheme, the function that multiple real-time systems share the physical hard disk is achieved, it is avoided that a single real-time system occupies the hard disk exclusively, the size of the hard disk space capable of being used by each real-time system can be flexibly configured, and the purpose of hard disk quota is achieved.

The application provides an object storage method and device. In the method, each storage block in a storage device corresponds to usage state information belonging to the storage block. When storing an object, a determined bucket name for storing the object to be stored, an object name of the object to be stored, an object version number of the object to be stored, and a data size of the object to be stored are obtained. A target data disk for uploading the object to be stored is determined according to the bucket name, the object version number, and the data size. Object data of the object to be stored is flushed into the target data disk according to the usage state information corresponding to the target data disk. An index disk for storing object metadata of the object to be stored is determined according to the bucket name, and the object metadata of the object to be stored is flushed into the index disk. It can be seen that the technical solution provided by the embodiment can improve the system storage performance and further reduce the disk space overhead.

The invention provides a method and system for preventing insufficient mirror image space of an embedded system, and the method comprises the steps: obtaining the distribution information of a disk space where a mirror image file is located after Android source code compiling is completed and the target mirror image file is generated; calculating used space and residual space of a specific partition in the disk; comparing the residual space with a preset threshold value; if the residual space is smaller than the threshold value, terminating the compiling process or generating error reporting information, and prompting that the mirror image space is insufficient; according to the method, the problem discovery opportunity is advanced from the debugging stage to the compiling stage, so that the repair cost is greatly reduced, the problem discovery opportunity is integrated into an automatic construction assembly line, manual intervention is not needed, the development efficiency is improved, the quality of factory mirror images is ensured, and batch production accidents caused by insufficient space are avoided.

The invention relates to the cross technical field of computational electromagnetism and precision permanent magnet device design, in particular to a method for improving the nonuniformity of a magnetic disk space magnetic field, and aims to solve the problems that a method for improving the uniformity of a magnetic field in the prior art is low in optimization efficiency and difficult to break through the uniformity bottleneck caused by angular harmonic waves and a structural coupling effect. According to the scheme, the method comprises the steps that an accurate finite element model containing seven circles of fan-shaped magnets, a parallel magnetic disk, an eddy current disk and an iron support is established in Opera3D, and meshing and solving are carried out; in the first stage, the structural height of the iron stand is optimized through parameterized scanning, and the optimal height parameter is determined; and in the second stage, on the basis of the optimal iron stand height, the outermost two circles of the magnetic disk are set as NdFeB. The non-uniformity deviation (delta B) of the magnetic field of the target spherical area can be reduced by 13%, and the method is suitable for high-precision scenes such as nuclear magnetic resonance and synchrotron radiation light sources and has the advantages of being efficient in design and high in repeatability.

This invention discloses a data processing method, apparatus, device, and storage medium. The method includes: acquiring a set of IP data packets; parsing each IP data packet in the set to obtain data flow information, wherein the data flow information includes: a 5-tuple of the IP data packets and the data flow of the IP data packets; dividing the set of IP data packets according to the 5-tuple of the IP data packets to obtain at least one data flow and a 5-tuple for each data flow; and determining the target path of each data flow and the data flow of the target path of each data flow based on the 5-tuple of each data flow and the data flow of the IP data packets in each data flow. Through the technical solution of this invention, disk space overhead can be reduced, hardware and network resource consumption can be lowered, and performance efficiency can be improved.

A method for implementing game resource loading in a mini-game, which is executed by a terminal. The method comprises: running a mini-game on the basis of a host application program, wherein the host application program runs on an operating system (S410); detecting whether the mini-game is bridged with a file system associated with the host application program, wherein the file system is used for managing a disk space corresponding to the host application program, and the disk space is used for storing a game resource package corresponding to the mini-game (S420); and in response to detecting that the mini-game is bridged with the file system, loading, by means of the file system, a game resource to be loaded in the game resource package from the disk space to an engine heap of a game engine (S430).

The invention provides a disk space consistency checking and repairing method and device, a medium and equipment, a disk space is formatted by adopting an FAT file system, the method comprises the steps that cluster indexes corresponding to different windows are determined from an initial cluster index of an FAT table based on the size of a preset window, the size of the preset window is N times of the cluster size, N is a natural number, and the initial cluster index of the FAT table is equal to the initial cluster index of the FAT table; the cluster size is determined according to disk space capacity; sequentially moving the windows, obtaining FAT table contents corresponding to the current window according to the cluster index corresponding to the current window, performing consistency check, and if the FAT table contents are inconsistent, marking the state of the current window as dirty; when the current window is moved to the new window, whether the FAT content corresponding to the current window is written back or not is determined according to the state of the current window. According to the method, the memory overhead can be greatly reduced, and system abnormity possibly caused by large memory overhead when equipment or a storage device with a limited memory performs consistency check and repair on internal or external disk space of the equipment or the storage device is avoided.

The invention relates to a quantity adjustment method and device, equipment and a storage medium. The method is applied to the technical field of storage systems and comprises the steps that under the condition that it is detected that the number of hard disks of a storage pool of the storage system is changed, the data block demand quantity and the number of currently available hard disks of the storage pool are obtained; according to the demand quantity of the data blocks and the quantity of the current available hard disks, adjusting the allocated quantity of the current available hard disks; wherein the allocated number is the number of the KOBJs allocated in the currently available hard disk, and the demand quantity of the data blocks is the number of the KOBJs required to meet the service demand. Compared with a traditional method that each hard disk needs to reserve a fixed number of KOBJs, the method has the advantages that the number of the distributed KOBJs in each hard disk can be dynamically adjusted according to the demanded quantity of the data blocks and the number of the currently available hard disks, so that the distribution flexibility of the KOBJs is improved, and the space utilization rate of the hard disks and the available space capacity of a user can be effectively improved.

The embodiment of the invention discloses a log data processing method and device, a terminal and a computer readable storage medium, and the method comprises the steps: obtaining a target original log generated by a target object and a log operation type of the target original log, and then determining a target storage log commonly associated with the target object and the log operation type, the method comprises the following steps: acquiring operation time information from a target original log, performing target system mapping processing on the operation time information to obtain time to-be-merged data, and finally performing time merging processing on the time to-be-merged data by using a time merging code in a target storage log to store log information of the target original log. Therefore, the technical problem that a large number of target original logs which have changes in time dimension often occupy a large disk space when stored is solved.

The application provides a storage system based on an NVMe interface, comprising a data acquisition module, a host exchange module and an NVMe host control module; after the data acquisition module acquires data to be stored, the data acquisition module sends a data storage command to the host exchange module; the host exchange module sends a write command to the NVMe host control module according to the storage command; the NVMe host control module is mounted with an NVMe ssd disk array, the NVMe host control module determines a data write address according to the write command, and then sends a response signal back to the host exchange module; the host exchange module sends a write instruction to the data acquisition module according to the response signal, the data acquisition module sends the cached data to be stored to the NVMe host control module, and the NVMe host control module stores the data to be stored in a fixed logical sector in the NVMe ssd disk array storage area according to the write address. The application can realize virtualization management of disk space, and effectively solve the problems of data storage, management and application of an aviation airborne data application platform.

The application provides a file downloading method, a file caching method and a server, and is applied to a server cluster. When the server cluster executes the file downloading method, if it is determined that no instance in the server cluster caches a file requested to be downloaded by a client, the downloading request is redirected to an instance that has cached the file, and the instance that has cached the file sends the file to the client. According to the application, only one copy of a file is cached in the server cluster, the disk space utilization of the server cluster can be improved, and storage resource waste can be avoided.

This invention relates to a load balancing method, apparatus, computer device, and readable storage medium. The method includes: splitting received traffic and configuring a load balancing strategy, which is a method for evenly distributing traffic across nodes; forwarding the split traffic to a public cloud and / or a private cloud according to the load balancing strategy; acquiring and updating various resource information of the traffic in the public and private clouds for analysis to determine the type of traffic and recording it, including storage cloud type, memory, CPU information, IP address, disk space, and bandwidth; and reconfiguring a traffic scheduling strategy based on the recorded traffic type, adjusting the load balancing strategy, which is a method for combining and forwarding different types of traffic. This method can comprehensively consider security and cost in a hybrid cloud environment, analyze and plan user traffic, thereby improving resource utilization and reducing user costs.

The application discloses a storage method of seismic data, and relates to the technical field of seismic exploration. The method comprises the following steps: acquiring seismic data; acquiring a data storage strategy; in response to the data storage strategy indicating that the seismic data is stored in a first disk, acquiring the residual space capacity of the first disk and the data volume of the seismic data; in the case that the residual space capacity of the first disk and the data volume of the seismic data meet the requirements of disk division storage, determining that the seismic data is stored by using the first disk and a second disk; creating a plurality of first data block files arranged in sequence in the first disk; creating a plurality of second data block files arranged in sequence in the second disk; and storing the seismic data into the plurality of first data block files and the plurality of second data block files arranged in sequence respectively based on a preset byte length. The method can solve the problem that the storage processing fails due to insufficient space of a single disk.

The invention discloses an OTA upgrading method, equipment and device for an application program and a medium, and relates to the technical field of vehicles. A part of the disk partitions in the whole disk partitions adopt the IMG upgrading mode, and compared with the mode that all the disk partitions adopt the IMG upgrading mode, the overall quantity of upgrading packages is reduced. And the other part of disk partitions adopt a file upgrading mode, so that multiple versions of redundant files are totally reduced, and the disk space is saved. And according to the partition address information of the second disk partition, constructing a virtual mirror image environment corresponding to the file upgrading mode, so that the mirror image environment under the file upgrading mode is the same as the mirror image environment under the IMG upgrading mode, and collaborative upgrading of different upgrading modes is realized. The stored application program is upgraded according to the upgrading modes of the first disk partition and the second disk partition, so that OTA upgrading is completed, the advantages and disadvantages of the two upgrading modes are considered, upgrading balance is achieved, it is guaranteed that the occupied disk space is small, and meanwhile the upgrading speed is increased.