54 results about "Distributed object" patented technology

The invention provides a life cycle deletion optimization method for a distributed object storage system, which comprises the following steps of: S1, detecting the business volume of a cluster, starting a pre-scanning operation when the business volume is lower than a preset threshold value, and identifying an object to be deleted according with a life cycle rule; s2, respectively writing the to-be-deleted object information of different dates into corresponding omaps, and storing omap data in a disk according to a preset packaging frequency; s3, when the life cycle expires, directly reading the omap of the corresponding date, skipping a real-time scanning step, and executing batch deletion operation; and S4, recording statistical information such as the deletion quantity scanned every day on the xattr of the barrel, so that management software performs data trend analysis and operation and maintenance decision. According to the embodiment of the invention, the life cycle deletion efficiency can be improved, the metadata operation pressure is reduced, and the cluster storage space utilization rate is optimized.

The invention discloses a resource adjustment method, electronic equipment, a storage medium and a program product, and relates to the technical field of distributed storage, the weight can be dynamically adjusted according to the use condition, the emergency state and the priority of real-time IO resources of clients, the differentiated IO requirements of multiple clients can be better met, and the user experience is improved. A stable low-delay demand or a periodic burst demand can be timely and effectively responded, and the dynamic adaptability is high; by dynamically adjusting the resource allocation strategy, the bandwidth can be flexibly and reasonably allocated according to the real-time demand of each client, so that the system can operate more efficiently, and services are provided for more clients; in a distributed object storage environment and under the same hardware resource condition, the optimized IO scheduling algorithm enables the system to be more efficient when processing a client request, system response delay is reduced, the data read-write speed is increased, and therefore the performance of the whole distributed storage system is improved.

Systems and methods are provided for receiving a vector to be inserted into a set of vectors, wherein the set of vectors is stored as a plurality of leaf objects of a distributed proximity-based graph across a plurality of storage devices of a distributed object storage system, identifying a subset of the plurality of leaf objects based at least partly on a similarity of the vector to one or more vectors stored in the subset of the plurality of leaf objects, storing the vector in an insert buffer associated with the subset of the plurality of leaf objects, and in response to a vector query, generating query results comprising the vector stored in the insert buffer, and at least one of the one or more vectors stored in the subset of the plurality of leaf objects.

The invention provides a virtual item processing method and device, equipment, a storage medium and a program product, and relates to the technical field of computers, the method comprises the following steps: determining a camp skill pool at least composed of object skills of camp objects in a first camp; in response to the fact that the first camp meets the skill distribution condition, at least part of object skills in the camp skill pool are distributed to the first camp, so that the first camp can control camp objects in the first camp to fight with the second camp by using the distributed object skills; in response to the attack of the first virtual object in the second camp, controlling to configure a virtual item for the first camp; and in response to a trigger operation for the virtual item, controlling the target object skill allocated to the first camp to use the virtual item, so that the target object skill obtains a specified skill gain when acting on a second virtual object in the second camp. The resource utilization rate of the terminal equipment can be improved.

This application relates to a method, apparatus, computer device, storage medium, and computer program product for distributing objects awaiting review. The method includes: responding to an object retrieval request, searching for a historical review index matching the requester; determining, based on the historical review index, a historical object identifier and a historical source identifier for the historical review object corresponding to the requester; searching for at least one target class index including the historical object identifier, and obtaining a first object awaiting review associated with each target class index, wherein the target class indexes are established based on object similarity; searching for a target source index from multiple source indexes based on the historical source identifier, and obtaining a second object awaiting review associated with each target source index; and determining a target object awaiting review matching the requester based on the first and second objects awaiting review, and pushing the target object awaiting review. This method enables accurate delivery of objects awaiting review.

This invention proposes a 3D semantic scene completion method based on hierarchical grouping and aggregation. The model proposes a novel dual-branch structure. The explicit constraint branch starts with the overall 3D scene features, focusing on regional aspects of the scene and aggregating explicitly similar features into grouped regional features. The implicit diffusion branch starts with the visible voxel query suggestions output by the query suggestion network, focusing on the details of objects in the scene and learning the implicit fine-grained features of the objects. A hierarchical grouping module is also proposed, which divides the 3D space into multiple sub-regions and performs similarity calculation and aggregation on the voxel features within each region, thereby generating a compact regional feature representation. This grouping method can focus on the local regions of specific objects in the scene, avoiding mutual interference from features of independently distributed objects in the distance, thus extracting more detailed and accurate semantic features.

This application relates to a method, apparatus, device, and computer-readable medium for dynamic garbage data recycling. The method includes: collecting operating parameters of a distributed object storage cluster and submitting these parameters to an analysis cluster; constructing dynamic load profiles of multiple storage buckets in the distributed object storage cluster based on the operating parameters in the analysis cluster; generating corresponding dynamic recycling strategies for each storage bucket according to its dynamic load profile; and recycling garbage data from each storage bucket according to the dynamic recycling strategies. This application constructs dynamic load profiles of storage buckets based on the collected operating parameters, achieving real-time perception and accurate characterization of the cluster's load status. This allows for the generation of targeted dynamic recycling strategies adapted to the load characteristics of each storage bucket, replacing the traditional static threshold triggering mechanism. This avoids resource contention during peak business periods and solves the technical problem that the static threshold triggering mechanism for garbage data recycling cannot adapt to dynamic load changes, leading to system performance degradation.

The invention provides a memory page allocation method, a readable storage medium and a computer program product. The allocation method is applied to a random access memory of a microcontroller, and comprises the following steps: obtaining a to-be-allocated object; sequentially taking each page in the N pages as a to-be-selected page, and according to the to-be-distributed object and the adjacent relation data, determining a page cutting overhead reduction amount between the to-be-distributed object and all adjacent objects when the to-be-distributed object is distributed to the to-be-selected page; according to the page cutting overhead reduction amount, the size of the to-be-distributed object and the page size of the to-be-selected page, calculating the income density when the to-be-distributed object is distributed to the to-be-selected page; wherein the adjacent object is an object having an adjacent access relationship with the to-be-distributed object; determining a target page from the N to-be-selected pages according to the revenue density, and distributing the to-be-distributed object to the target page; according to the method, the page cutting overhead of the RAM of the microcontroller can be reduced, and the ROM space of the microcontroller can be optimized.

The application discloses a data backup system and method, a storage medium and an electronic device, and relates to the field of financial technology. The system comprises: a ledger database, which is used to acquire information of a database group and generate a backup strategy corresponding to the database group; a backup management platform, which is used to acquire the backup strategy, execute a backup task of the database group through a backup database in the case that a backup mode is remote backup, and backup data generated by the backup task to a distributed object storage system; and the distributed object storage system, which is used to receive the data generated by the backup task. Through the application, the problems of large occupation of built-in SSD storage disk space by backup data and difficult management of backup data in the related art are solved.

The invention discloses a water conservancy knowledge base and intelligent question and answer construction method based on a large model and RAG, and the method comprises the steps: 1, combing a water conservancy knowledge system, and sorting water conservancy professional documents and data as materials of the knowledge base; step 2, constructing a water conservancy knowledge library management system through a J2EE system, a B / S architecture and a distributed object storage system; step 3, based on the RAG technology, forming different knowledge bases according to the sorted knowledge classification and confidentiality security level of the water conservancy industry, and establishing a water conservancy knowledge intelligent question-answering system on the knowledge bases; 4, performing extended application on the basis of the constructed water conservancy knowledge intelligent question-answering system; the problems that in the prior art, due to the fact that unstructured data processing is weak when a water conservancy knowledge base is constructed, a large number of image-text mixed documents such as PDF and PPT cannot be effectively utilized, and the recall rate and the accuracy rate are not high are solved.

The invention provides a real-time online visualization method and device for multi-resolution grid data, and belongs to the technical field of data processing and visualizing.The method comprises the steps that firstly, grid data are merged into sequence columns in the Z direction to form a multi-resolution stacked grid model, the multi-resolution stacked grid model is stored in an HDF5 file according to resolution levels, and parallel I / O is achieved in combination with MinIO distributed object storage; secondly, a Z-Order index and directory server strategy is designed, and the data scheduling and transmission efficiency is improved; a browser end adopts a virtual quadtree structure to organize data, and realizes multi-thread real-time data receiving in combination with WebWorker and WebSocket, so that the blockage of a main thread is avoided; finally, the LOD level is dynamically selected based on the viewpoint distance, and efficient volume rendering is achieved through a GPU texture array and LOD InfoTexture. According to the method, online real-time updating is supported, the loading delay is remarkably reduced, and the visual frame rate is improved.

This invention provides a method and apparatus for real-time online visualization of multi-resolution grid data, belonging to the field of data processing and visualization technology. First, the grid data is merged into hierarchical columns along the Z-axis to form a multi-resolution stacked grid model, which is then stored in HDF5 files according to resolution levels. Parallel I / O is achieved using MinIO distributed object storage. Second, a Z-Order index and directory server strategy are designed to improve data scheduling and transmission efficiency. On the browser side, a virtual quadtree structure is used to organize the data, and WebWorker and WebSocket are used to achieve multi-threaded real-time data reception, avoiding main thread blocking. Finally, the LOD level is dynamically selected based on the viewpoint distance, and efficient volume rendering is achieved using GPU texture arrays and LODInfoTexture. This method supports online real-time updates, significantly reduces loading latency, and improves the visualization frame rate.

The invention discloses a building space landing point selection method and device and a computer readable storage medium, and the method comprises the steps: obtaining the object attribute of a to-be-distributed object and the task attribute of a building distribution task in the execution process of the building distribution task; generating observation options for the current building area according to the object attributes, and obtaining observation data of the current building area according to the observation options; determining to-be-selected landing points of the building distribution task according to observation data, and performing priority ranking on the to-be-selected landing points according to the task attributes; executing the landing operation of the building distribution task according to the priority from high to low; therefore, for dense building scenes such as commercial street areas and residential districts, the landing point selection strategy of the building space is optimized, the pickup difficulty is reduced, and the flight safety is guaranteed.

The application discloses a resource adjustment method, an electronic device, a storage medium and a program product, relates to the technical field of distributed storage, and can dynamically adjust the weight according to the use condition, burst state and priority of real-time IO resources of a client, better meets differentiated IO demands of multiple clients, can be in time and effective response to stable low-delay demands or periodic burst demands, and has strong dynamic adaptability; the application can flexibly and reasonably allocate bandwidth according to real-time demands of each client by dynamically adjusting a resource allocation strategy, enables the system to be more efficient, and provides services for more clients; in a distributed object storage environment, under the condition of equivalent hardware resources, the optimized IO scheduling algorithm enables the system to be more efficient when processing client requests, reduces system response delay, improves data read-write speed, and thus improves the performance of the entire distributed storage system.

The invention discloses an aircraft protection method and device and a computer readable storage medium, and the method comprises the steps: judging whether the current height exceeds a first height threshold value or not when an aircraft enters an emergency state; if so, opening a main parachute of the aircraft; if not, the free landing speed of the current height is estimated, and whether the free landing speed exceeds a second speed threshold value or not is judged; if not, a main air bag of the aircraft is opened, and if yes, a delayed opening instruction of an auxiliary parachute and / or an auxiliary air bag of the delivery object is set firstly, and after the auxiliary parachute and / or the auxiliary air bag are / is separated from the aircraft, the main air bag of the aircraft is opened; therefore, the air bag protection scheme of the unmanned aerial vehicle can be optimized to a great extent aiming at building dense scenes such as commercial streets and residential districts, the distribution requirements of the building dense scenes such as the commercial streets and the residential districts are met, and the flight safety and object safety in emergency situations are guaranteed.

The application discloses a distributed object storage system data monitoring method and device and a medium thereof, relates to the technical field of distributed object storage, and aims to provide an implementation mode for data monitoring, and provides a distributed object storage system data monitoring method for solving the problem that the current data monitoring mode has a great influence on performance. According to the distributed object storage system data monitoring method, the request information is first stored in a cache, part of data in the request information is counted according to a preset monitoring requirement, data monitoring information is obtained, and the data monitoring information is saved in a storage pool, so that the data monitoring information can be called when needed. Therefore, the amount of data written into the storage system or the amount of data read from the storage system when a user queries the data monitoring information is less than the amount of data stored in the storage system in the current mode, and the difference is more obvious when the request information contains more requests.

The utility model provides a distribution mechanism capable of highly reliably distributing distributed objects according to game results and a game device provided with the distribution mechanism. A dispensing mechanism for dispensing a dispensed item associated with a game, comprising: an accommodating portion accommodating the dispensed item; a first operation part which is provided with the accommodating part and enables the accommodating part to operate; a second operation part configured so as to be able to operate while holding the dispensed object pushed out from the accommodating part; the push-out mechanism is arranged corresponding to the first action part and used for pushing out the distributed object, and the push-out mechanism comprises a first push-out part used for pushing out the distributed object in the containing part to the second action part; and a second push-out part that operates in a direction different from the operation direction of the first push-out part and pushes out the dispensed object from the second operation part to the outside of the second operation part, the first push-out part being arranged at an angle to the second push-out part at a predetermined angle.

A distributed object storage method, a device and a medium are provided, and the method includes: splitting a target object to be stored into a quantity of key-value pair data; determining target partitions corresponding respectively to the quantity of key-value pair data from a plurality of partitions of a preset distributed object storage system; determining, based on a preset partition view, data storage nodes that currently hold the target partitions, to obtain data storage nodes corresponding respectively to the quantity of key-value pair data; and caching the quantity of key-value pair data into the data storage nodes corresponding respectively to the quantity of key-value pair data.

Snapshot or point-in-time image functionality improves the use of object-based datastores. An example system includes an object-based datastore and a metadata datastore associated with the object-based datastore. Instances of the metadata datastore each identify the distributed data blocks that respectively store the objects included in the object-based datastore. An instance of the metadata datastore is used as a snapshot image of a set of objects of the object-based datastore based on identifying the distributed data blocks that were mapped to the set of objects during a point in time. A different instance of the metadata datastore is dynamically updated to reflect present mappings of distributed data blocks to objects in the object-based datastore. Different instances of the metadata datastore are used to read objects from previous timepoints, restore the object-based datastore to a previous snapshot image, enable intelligent deletion of objects of the object-based data store, and more.

The invention discloses a building engineering management and control system based on a BIM technology, relates to the technical field of engineering data management, and solves the technical problems that differentiated management strategies are not made according to the business value of data, core data and conventional data are stored in a mixed manner, the safety of the core data cannot be guaranteed, and storage resources of the conventional data are wasted. According to the method, data is divided into core data and conventional data through a classification rule based on business core, sensitivity and reusability, so that subsequent storage and authority management and control better meet business requirements, an independent physical partition and encrypted security policy is adopted for the core data, the independent partition is physically isolated from the conventional data, and the security of the core data is improved. Encryption and authority control ensure that core data is not leaked and tampered; for conventional data classification processing based on capacity threshold values, elastic capacity expansion is realized by adopting distributed object storage, the conventional data storage cost is reduced, sharing convenience is guaranteed through a lightweight access interface, and dual optimization of safety and cost is realized.

The invention discloses an information storage system of network security equipment, which comprises a real-time analysis layer for receiving original flow metadata, triggering an annular buffer management module when the data volume reaches a preset threshold value, covering low-value data in short time, and retaining a session record which is being analyzed by a threat detection engine; the tactical storage layer is used for migrating cold data to a low-cost storage medium when the data access frequency is reduced, performing tactical data traceability and sending security audit data to a lower layer; the strategic storage layer is used for storing data fragments in a mixed medium formed by distributed object storage and a tape library, and encrypting and solidifying sensitive data; secondly, establishing a non-tampering hash chain anchor for judicial evidence data, and transferring the data to a lower layer when the data is close to the end point of a life cycle; the archiving and destroying layer is used for encrypting and fragmenting the data and storing the data in a geographic distributed medium, and carrying out on-chain evidence storage on data fingerprints; when a destruction condition is triggered, a multi-factor authentication process is performed.

Methods in a cloud object store facilitate strong data encryption, customer-management of object (encryption) keys, reductions in latency, globally-distributed object storage, and handling of streamed uploads. A method for encrypting objects stored in a cloud includes encrypting each object with a unique encryption (object) key. The plaintext object keys are generated in advance of uploads. The plaintext object keys can be stored in an object database in the cloud. Alternatively, the plaintext object keys can be provided to a customer's HSM, encrypted, and returned to the cloud, such that encrypted object keys, encrypted by the customer, are stored in the cloud. The cloud can alternatively encrypt the customer's object keys with a master key for the customer, which is then encrypted by the customer's HSM before being stored in the cloud. Proxies are also deployed for efficiently communicating with customer security modules.

This invention provides a data storage method and system for distributed object storage. The method includes: encoding the original data of the target object using erasure coding to generate a group of shards to be written, containing k data shards and m check shards; writing each shard to independent physical extended shards on different storage nodes, wherein the extended shards are stored hierarchically using record blocks and check information blocks; generating a write success response when the number of successfully written shards reaches a preset threshold (≥k and ≤k+m); and performing a sealing operation on the extended shards after writing, using the minimum logical commit length of each successfully written shard as the trust boundary, truncating excess data and locking write permissions. This application solves the dilemma of existing systems where some shards cannot be securely confirmed after writing, eliminates node blocking, balances write efficiency and data consistency, and improves the availability, integrity, and efficiency of the storage system.

The application discloses a data distribution method and device, equipment, medium and product, and relates to the field of resource distribution algorithm, and determines a user trust graph based on a communication request initiated by a request initiator to a request receiver, initial trust values of the request initiator and the request receiver, and a user library; determines a target trust value by updating the initial trust values in the user trust graph in real time based on a distribution task identifier, user registration information of the request initiator and the request receiver, a transfer request between the request initiator and the request receiver, and a third-party database; and distributes a to-be-distributed object to the request initiator and the request receiver based on the target trust value and a trust value threshold. By introducing the user trust graph on the block chain and the real-time updating mechanism, the technical scheme can ensure the reasonable distribution of a large amount of data resources and solve the problem of ensuring the effective distribution of data resources in a high-concurrency scenario.

The application discloses a distributed cache method and equipment for SSD data redefinition, the distributed cache method comprises the following steps: in the case that foreground data is written into a cache pool, directly writing a distributed object to a master target of the cache pool, so as to be based on the cache pool and be transferred to a back end; and writing metadata information of any cache distributed object to a slave target of the cache pool, wherein the metadata information is redundant; in the case that any node state changes, using the cache pool to send an updated hard disk pool topology structure to all nodes, so that each node scans cached metadata information in the node based on the updated hard disk pool topology structure, converts metadata cache into data cache, and recovers the cache. The application embodiment triggers distributed cache data switching through hard disk pool topology structure change, reduces recovery overhead, and improves data recovery speed.

The present disclosure provides a method for synchronizing a plurality of data stores of a distributed object store, the method comprising: causing a first data store of the data stores to become online after having been offline; selecting a second data store of the data stores, the second data store being online when the first data store is offline; reading an entry from a follow-up log by the first data store; and performing a data modification operation corresponding to the entry on the first data store to synchronize the plurality of data stores. A distributed object store and a non-transitory computer readable medium are also provided.

Embodiments of the present disclosure relate to a distributed object storage method, apparatus, device and medium, wherein the method comprises: splitting a target object to be stored into a plurality of key-value pair data; determining a target partition corresponding to each of the plurality of key-value pair data from a plurality of partitions of a preset distributed object storage system; determining a data storage node currently holding the target partition based on a preset partition view to obtain a data storage node corresponding to each of the plurality of key-value pair data; wherein the partition view is used to indicate meta information of the plurality of partitions, and the meta information at least contains information of the data storage node holding the partition; the data storage node is a storage node of the distributed object storage system; and caching the plurality of key-value pair data into the corresponding data storage node. Embodiments of the present disclosure can effectively alleviate the local overload problem of the object storage service cluster.

Systems and methods are provided for receiving a vector to be inserted into a set of vectors, wherein the set of vectors is stored as a plurality of leaf objects of a distributed proximity-based graph across a plurality of storage devices of a distributed object storage system, identifying a subset of the plurality of leaf objects based at least partly on a similarity of the vector to one or more vectors stored in the subset of the plurality of leaf objects, storing the vector in an insert buffer associated with the subset of the plurality of leaf objects, and in response to a vector query, generating query results comprising the vector stored in the insert buffer, and at least one of the one or more vectors stored in the subset of the plurality of leaf objects.

Disclosed is a heterogeneous database management system comprising: a database control unit connected to a plurality of heterogeneous databases and controlling the databases; a distributed object storage unit connected to the database control unit and storing the data change history of at least one database among the plurality of heterogeneous databases; a data encryption unit for encrypting the data change history stored in the distributed object storage unit; and an access control unit for controlling access to at least one database among the plurality of heterogeneous databases, wherein, when a database management request for at least one database among the plurality of heterogeneous databases is received, the database control unit transmits the management request to the at least one database and stores, in the distributed object storage unit, changes in the database corresponding to the database management request.

The application provides a distributed object storage data writing reliability improving method and device, relates to the technical field of distributed storage, and can improve the writing success rate of to-be-written data, reduce the possibility of occurrence of the situation that to-be-written data cannot be successfully written, improve the reliability of distributed object storage data writing, and guarantees the continuity of business. Moreover, the method does not need to increase a backup pool, and can reduce the cost of data writing.