31 results about "Distributed object" patented technology

This application relates to a method, apparatus, device, and computer-readable medium for dynamic garbage data recycling. The method includes: collecting operating parameters of a distributed object storage cluster and submitting these parameters to an analysis cluster; constructing dynamic load profiles of multiple storage buckets in the distributed object storage cluster based on the operating parameters in the analysis cluster; generating corresponding dynamic recycling strategies for each storage bucket according to its dynamic load profile; and recycling garbage data from each storage bucket according to the dynamic recycling strategies. This application constructs dynamic load profiles of storage buckets based on the collected operating parameters, achieving real-time perception and accurate characterization of the cluster's load status. This allows for the generation of targeted dynamic recycling strategies adapted to the load characteristics of each storage bucket, replacing the traditional static threshold triggering mechanism. This avoids resource contention during peak business periods and solves the technical problem that the static threshold triggering mechanism for garbage data recycling cannot adapt to dynamic load changes, leading to system performance degradation.

The invention provides a memory page allocation method, a readable storage medium and a computer program product. The allocation method is applied to a random access memory of a microcontroller, and comprises the following steps: obtaining a to-be-allocated object; sequentially taking each page in the N pages as a to-be-selected page, and according to the to-be-distributed object and the adjacent relation data, determining a page cutting overhead reduction amount between the to-be-distributed object and all adjacent objects when the to-be-distributed object is distributed to the to-be-selected page; according to the page cutting overhead reduction amount, the size of the to-be-distributed object and the page size of the to-be-selected page, calculating the income density when the to-be-distributed object is distributed to the to-be-selected page; wherein the adjacent object is an object having an adjacent access relationship with the to-be-distributed object; determining a target page from the N to-be-selected pages according to the revenue density, and distributing the to-be-distributed object to the target page; according to the method, the page cutting overhead of the RAM of the microcontroller can be reduced, and the ROM space of the microcontroller can be optimized.

The application discloses a data backup system and method, a storage medium and an electronic device, and relates to the field of financial technology. The system comprises: a ledger database, which is used to acquire information of a database group and generate a backup strategy corresponding to the database group; a backup management platform, which is used to acquire the backup strategy, execute a backup task of the database group through a backup database in the case that a backup mode is remote backup, and backup data generated by the backup task to a distributed object storage system; and the distributed object storage system, which is used to receive the data generated by the backup task. Through the application, the problems of large occupation of built-in SSD storage disk space by backup data and difficult management of backup data in the related art are solved.

The invention discloses a water conservancy knowledge base and intelligent question and answer construction method based on a large model and RAG, and the method comprises the steps: 1, combing a water conservancy knowledge system, and sorting water conservancy professional documents and data as materials of the knowledge base; step 2, constructing a water conservancy knowledge library management system through a J2EE system, a B / S architecture and a distributed object storage system; step 3, based on the RAG technology, forming different knowledge bases according to the sorted knowledge classification and confidentiality security level of the water conservancy industry, and establishing a water conservancy knowledge intelligent question-answering system on the knowledge bases; 4, performing extended application on the basis of the constructed water conservancy knowledge intelligent question-answering system; the problems that in the prior art, due to the fact that unstructured data processing is weak when a water conservancy knowledge base is constructed, a large number of image-text mixed documents such as PDF and PPT cannot be effectively utilized, and the recall rate and the accuracy rate are not high are solved.

This invention provides a method and apparatus for real-time online visualization of multi-resolution grid data, belonging to the field of data processing and visualization technology. First, the grid data is merged into hierarchical columns along the Z-axis to form a multi-resolution stacked grid model, which is then stored in HDF5 files according to resolution levels. Parallel I / O is achieved using MinIO distributed object storage. Second, a Z-Order index and directory server strategy are designed to improve data scheduling and transmission efficiency. On the browser side, a virtual quadtree structure is used to organize the data, and WebWorker and WebSocket are used to achieve multi-threaded real-time data reception, avoiding main thread blocking. Finally, the LOD level is dynamically selected based on the viewpoint distance, and efficient volume rendering is achieved using GPU texture arrays and LODInfoTexture. This method supports online real-time updates, significantly reduces loading latency, and improves the visualization frame rate.

The invention discloses a building space landing point selection method and device and a computer readable storage medium, and the method comprises the steps: obtaining the object attribute of a to-be-distributed object and the task attribute of a building distribution task in the execution process of the building distribution task; generating observation options for the current building area according to the object attributes, and obtaining observation data of the current building area according to the observation options; determining to-be-selected landing points of the building distribution task according to observation data, and performing priority ranking on the to-be-selected landing points according to the task attributes; executing the landing operation of the building distribution task according to the priority from high to low; therefore, for dense building scenes such as commercial street areas and residential districts, the landing point selection strategy of the building space is optimized, the pickup difficulty is reduced, and the flight safety is guaranteed.

The application discloses a resource adjustment method, an electronic device, a storage medium and a program product, relates to the technical field of distributed storage, and can dynamically adjust the weight according to the use condition, burst state and priority of real-time IO resources of a client, better meets differentiated IO demands of multiple clients, can be in time and effective response to stable low-delay demands or periodic burst demands, and has strong dynamic adaptability; the application can flexibly and reasonably allocate bandwidth according to real-time demands of each client by dynamically adjusting a resource allocation strategy, enables the system to be more efficient, and provides services for more clients; in a distributed object storage environment, under the condition of equivalent hardware resources, the optimized IO scheduling algorithm enables the system to be more efficient when processing client requests, reduces system response delay, improves data read-write speed, and thus improves the performance of the entire distributed storage system.

The invention discloses an aircraft protection method and device and a computer readable storage medium, and the method comprises the steps: judging whether the current height exceeds a first height threshold value or not when an aircraft enters an emergency state; if so, opening a main parachute of the aircraft; if not, the free landing speed of the current height is estimated, and whether the free landing speed exceeds a second speed threshold value or not is judged; if not, a main air bag of the aircraft is opened, and if yes, a delayed opening instruction of an auxiliary parachute and / or an auxiliary air bag of the delivery object is set firstly, and after the auxiliary parachute and / or the auxiliary air bag are / is separated from the aircraft, the main air bag of the aircraft is opened; therefore, the air bag protection scheme of the unmanned aerial vehicle can be optimized to a great extent aiming at building dense scenes such as commercial streets and residential districts, the distribution requirements of the building dense scenes such as the commercial streets and the residential districts are met, and the flight safety and object safety in emergency situations are guaranteed.

The application discloses a distributed object storage system data monitoring method and device and a medium thereof, relates to the technical field of distributed object storage, and aims to provide an implementation mode for data monitoring, and provides a distributed object storage system data monitoring method for solving the problem that the current data monitoring mode has a great influence on performance. According to the distributed object storage system data monitoring method, the request information is first stored in a cache, part of data in the request information is counted according to a preset monitoring requirement, data monitoring information is obtained, and the data monitoring information is saved in a storage pool, so that the data monitoring information can be called when needed. Therefore, the amount of data written into the storage system or the amount of data read from the storage system when a user queries the data monitoring information is less than the amount of data stored in the storage system in the current mode, and the difference is more obvious when the request information contains more requests.

The utility model provides a distribution mechanism capable of highly reliably distributing distributed objects according to game results and a game device provided with the distribution mechanism. A dispensing mechanism for dispensing a dispensed item associated with a game, comprising: an accommodating portion accommodating the dispensed item; a first operation part which is provided with the accommodating part and enables the accommodating part to operate; a second operation part configured so as to be able to operate while holding the dispensed object pushed out from the accommodating part; the push-out mechanism is arranged corresponding to the first action part and used for pushing out the distributed object, and the push-out mechanism comprises a first push-out part used for pushing out the distributed object in the containing part to the second action part; and a second push-out part that operates in a direction different from the operation direction of the first push-out part and pushes out the dispensed object from the second operation part to the outside of the second operation part, the first push-out part being arranged at an angle to the second push-out part at a predetermined angle.

A distributed object storage method, a device and a medium are provided, and the method includes: splitting a target object to be stored into a quantity of key-value pair data; determining target partitions corresponding respectively to the quantity of key-value pair data from a plurality of partitions of a preset distributed object storage system; determining, based on a preset partition view, data storage nodes that currently hold the target partitions, to obtain data storage nodes corresponding respectively to the quantity of key-value pair data; and caching the quantity of key-value pair data into the data storage nodes corresponding respectively to the quantity of key-value pair data.

Snapshot or point-in-time image functionality improves the use of object-based datastores. An example system includes an object-based datastore and a metadata datastore associated with the object-based datastore. Instances of the metadata datastore each identify the distributed data blocks that respectively store the objects included in the object-based datastore. An instance of the metadata datastore is used as a snapshot image of a set of objects of the object-based datastore based on identifying the distributed data blocks that were mapped to the set of objects during a point in time. A different instance of the metadata datastore is dynamically updated to reflect present mappings of distributed data blocks to objects in the object-based datastore. Different instances of the metadata datastore are used to read objects from previous timepoints, restore the object-based datastore to a previous snapshot image, enable intelligent deletion of objects of the object-based data store, and more.

Methods in a cloud object store facilitate strong data encryption, customer-management of object (encryption) keys, reductions in latency, globally-distributed object storage, and handling of streamed uploads. A method for encrypting objects stored in a cloud includes encrypting each object with a unique encryption (object) key. The plaintext object keys are generated in advance of uploads. The plaintext object keys can be stored in an object database in the cloud. Alternatively, the plaintext object keys can be provided to a customer's HSM, encrypted, and returned to the cloud, such that encrypted object keys, encrypted by the customer, are stored in the cloud. The cloud can alternatively encrypt the customer's object keys with a master key for the customer, which is then encrypted by the customer's HSM before being stored in the cloud. Proxies are also deployed for efficiently communicating with customer security modules.

This invention provides a data storage method and system for distributed object storage. The method includes: encoding the original data of the target object using erasure coding to generate a group of shards to be written, containing k data shards and m check shards; writing each shard to independent physical extended shards on different storage nodes, wherein the extended shards are stored hierarchically using record blocks and check information blocks; generating a write success response when the number of successfully written shards reaches a preset threshold (≥k and ≤k+m); and performing a sealing operation on the extended shards after writing, using the minimum logical commit length of each successfully written shard as the trust boundary, truncating excess data and locking write permissions. This application solves the dilemma of existing systems where some shards cannot be securely confirmed after writing, eliminates node blocking, balances write efficiency and data consistency, and improves the availability, integrity, and efficiency of the storage system.

The application discloses a data distribution method and device, equipment, medium and product, and relates to the field of resource distribution algorithm, and determines a user trust graph based on a communication request initiated by a request initiator to a request receiver, initial trust values of the request initiator and the request receiver, and a user library; determines a target trust value by updating the initial trust values in the user trust graph in real time based on a distribution task identifier, user registration information of the request initiator and the request receiver, a transfer request between the request initiator and the request receiver, and a third-party database; and distributes a to-be-distributed object to the request initiator and the request receiver based on the target trust value and a trust value threshold. By introducing the user trust graph on the block chain and the real-time updating mechanism, the technical scheme can ensure the reasonable distribution of a large amount of data resources and solve the problem of ensuring the effective distribution of data resources in a high-concurrency scenario.

Systems and methods are provided for receiving a vector to be inserted into a set of vectors, wherein the set of vectors is stored as a plurality of leaf objects of a distributed proximity-based graph across a plurality of storage devices of a distributed object storage system, identifying a subset of the plurality of leaf objects based at least partly on a similarity of the vector to one or more vectors stored in the subset of the plurality of leaf objects, storing the vector in an insert buffer associated with the subset of the plurality of leaf objects, and in response to a vector query, generating query results comprising the vector stored in the insert buffer, and at least one of the one or more vectors stored in the subset of the plurality of leaf objects.

Disclosed is a heterogeneous database management system comprising: a database control unit connected to a plurality of heterogeneous databases and controlling the databases; a distributed object storage unit connected to the database control unit and storing the data change history of at least one database among the plurality of heterogeneous databases; a data encryption unit for encrypting the data change history stored in the distributed object storage unit; and an access control unit for controlling access to at least one database among the plurality of heterogeneous databases, wherein, when a database management request for at least one database among the plurality of heterogeneous databases is received, the database control unit transmits the management request to the at least one database and stores, in the distributed object storage unit, changes in the database corresponding to the database management request.

The application provides a distributed object storage data writing reliability improving method and device, relates to the technical field of distributed storage, and can improve the writing success rate of to-be-written data, reduce the possibility of occurrence of the situation that to-be-written data cannot be successfully written, improve the reliability of distributed object storage data writing, and guarantees the continuity of business. Moreover, the method does not need to increase a backup pool, and can reduce the cost of data writing.

In one embodiment, distributed data storage systems and methods integrate a change tracking manager with scalable databases. According to one embodiment, a computer implemented method comprises integrating change tracking of storage objects into the distributed object storage database that includes a first database of a first type and one or more chapter databases of a second type with the distributed object storage database supporting a primary lookup index and a secondary lookup index in order to locate a storage object. The method includes recording in a header of a chapter database a network topology for connecting a bucket having the chapter database to a first peer bucket when a new mirror to the first peer bucket is being established, and recording a first directive into the header of the chapter database to express a type of content to be mirrored from the bucket to the first peer bucket.

This invention discloses a data import method and a computer-readable storage medium. The method includes: acquiring data to be imported according to a preset period; storing the data to be imported as a temporary file according to a preset storage format, and uploading the temporary file to a distributed object storage system; creating an S3 external table based on the fields of a target table in the database, and setting the storage path of the S3 external table to the storage path of the distributed object storage system; and importing the data from the temporary file into the target table through the S3 external table. This invention can improve the import speed of batch data and reduce the load on the master node.

The invention discloses a data processing method and device, equipment, a storage medium and a program product, and the method comprises the steps: determining the compression configuration information of a client according to a data uploading request when the data uploading request sent by the client is received; if the compression configuration information indicates that the client starts a compression function, reading to-be-compressed data uploaded by the client; determining a corresponding compression model and model parameters according to the type characteristics of the to-be-compressed data; wherein the compression model performs parameter configuration based on the model parameters; and inputting the to-be-compressed data into the compression model, and obtaining compressed data output by the compression model. By adopting the embodiment of the invention, the problem of high offline compression time delay in distributed object storage can be effectively solved, online intelligent compression of the server side is realized, and the compression rate and the processing speed are improved.

The invention relates to an object distribution device (2) comprising: a parallelepiped housing (20) defined by a plurality of outer walls, arranged to form at least one first hollow compartment; a front wall (21) having at least one hole (210); a receiving space (211) arranged in the hollow compartment, at least one portion of which is positioned opposite said hole (210) and suitable for receiving an object storage device; and a closure means (22) arranged in the front wall (21) and configured to be movable between an open position and a closed position.

The invention provides a storage management method and system for a multi-source space-based data image, and relates to the technical field of data processing, and the method comprises the steps: obtaining original space-based image data, carrying out the feature analysis, and generating a standard structured data item; constructing a space-time grid division rule, carrying out classification according to data attributes, and generating a global logic storage path identifier; performing association to generate an association mapping relationship, and persisting the association mapping relationship to the distributed metadatabase; responding to the data query request, analyzing the data query request through the distributed metadatabase, and positioning target data; and constructing a distributed object storage cluster, and performing parallel reading to obtain a target image file. The technical problems that in the prior art, the parallel processing capacity of large-scale data is limited, parallel reading and efficient query are difficult to support effectively in the environment of a large-scale data set, the data access performance is poor, and then query delay and load increase are caused are solved.

This application provides a method, apparatus, device, medium, and product for continuous data protection, relating to the field of data processing technology. The method involves acquiring write input / output requests from a target device and copying the original request and the copy request. The original request is submitted to the target device, and write records are generated based on the copy request. This ensures both normal business processing by the target device and complete recording of data changes. Next, the write records are cached in a data cache and aggregated when preset batch processing conditions are triggered. This avoids a large number of fine-grained write operations directly impacting the storage system, reducing the inefficiency of data protection caused by frequent disk access and network transmission. Subsequently, the aggregated batch is first persistently stored in a local cache device, and then sent to a remote distributed object storage cluster after successful batch persistence. This improves storage I / O operation efficiency and enhances the reliability and flexibility of data protection.

The present disclosure provides a database generation method, which can be applied to the field of cloud computing technology. The database generation method comprises: setting an interceptor for at least one component in a distributed object, obtaining at least one interceptor; wherein the interceptor is used to intercept a container resource application request sent by an application layer SaaS to a platform layer PaaS and receive data information of an event corresponding to the container resource application request processed by a container in the platform layer PaaS; and in response to the container resource application request and the data information of the event received by the at least one interceptor, a database corresponding to the distributed object is generated. The present disclosure also provides a management method, device, equipment, storage medium and program product for a distributed object.

A method for efficient distributed object manager (DOM) owner migration in a virtual storage area network (VSAN) is provided. Embodiments include determining to migrate a DOM owner object from a source DOM owner server to a destination DOM owner server. Embodiments include determining that an input or output (I / O) operation affecting the DOM owner object is in progress. Embodiments include, prior to updating the DOM owner object based on the I / O operation, transferring the DOM owner object from the source DOM owner server to the destination DOM owner server. Embodiments include completing execution of the I / O operation on the destination DOM owner server. Embodiments include updating the DOM owner object on the destination DOM owner server based on the I / O operation.

The invention relates to a distributed object storage processing method and device, equipment and a medium. The distributed object storage processing method comprises the following steps: quantitatively and asynchronously moving target data in an old data engine into a data cluster of a new data engine; key value pair information corresponding to the target data is updated in a metadata cluster; and in response to a data request of a user, processing target data in the new data engine based on the key value pair information. According to the embodiment of the invention, the request delay can be reduced, and the user experience is improved.

A cluster may be dimensioned based on first input features defining data objects to be stored in the one or more data stores. One or more second input features may be calculated according to the first input features, the first input features and the second input features defining resource requirements of the data objects due to at least one of data storage format, replication, or parity data. Output features are calculated based on the first input features and the second input features, the output features defining the dimensioning of the cluster for the one or more data stores. A cluster may be provisioned and instantiated according to the dimensioning.

The invention discloses a metadata pushing method and device for distributed object storage. The method comprises the following steps: receiving an object uploaded by a user; storing the object in a distributed object storage system, and recording metadata of the object and the operation event information in a log; notifying the ES site to pull the log; the ES site sends an incremental log pulling request to the main site according to the local synchronization state after receiving the notification; receiving an incremental log pulling request sent by the ES site, and sending an incremental log to the ES site; and after receiving the incremental logs, the ES site merges and arranges the incremental logs to obtain a push list and related information, and pushes the metadata to the ES in batches according to the push list. According to the method, the log generated during data writing contains the metadata, a large number of invalid IO requests during log playback are reduced, the data processing capacity is improved, and the metadata pushing efficiency is improved by adopting a manner of acquiring the logs in batches and a manner of pushing the logs to the ES.

This disclosure provides a method, apparatus, and device for processing replication operations based on distributed object storage, relating to artificial intelligence, and particularly to the technical fields of cloud computing, cloud storage, and content delivery networks. The specific implementation scheme is as follows: In response to a processing request sent by a terminal device, the metadata of the header object data of the source object indicated by the processing request is read and saved to a preset file; wherein, the processing request is used to instruct a replication operation on the source object; the source object includes header object data and multiple fragment data, the header object data having metadata, the metadata representing the descriptive information of the source object; replication operations are performed on the fragment data; if it is determined that the replication operations on each fragment data are successful, the name of the preset file is set to the name of the target object to obtain the target object. This reduces the amount of data processing, improves the speed of object replication operations, and reduces the consumption of hardware resources.