238 results about "Object store" patented technology

A database system integrates in-database machine learning (ML) models with in-database large language models (LLMs) or other generative artificial intelligence (AI) models that enable new applications. The database system receives one or more inferences from an ML model and provides an inference input to a retrieval agent of an object store. One or more vector stores represent a plurality of reference documents using semantic encodings. The retrieval agent performs a similarity search of the one or more vector stores to retrieve a set of passages from the plurality of reference documents based on similarity of encodings of the inference input and encodings of passages in the plurality of reference documents. The database system generates a linguistic prompt for an LLM having a context including the inferences and passages and applies the LLM to the linguistic prompt to generate a natural language explanation of the one or more inferences.

Techniques are described for enabling concurrent and non-blocking replication object deletion during cross-region replications. In some embodiments, in a target file system, a target replication pipeline as part of a cross-region replication, and a deletion pipeline operate in parallel. The deletion pipeline deletes processed objects reaching the last pipeline stage of the target replication pipeline after each checkpoint in the target replication pipeline. In some embodiments, after a non-recoverable failure during the cross-region replication, the cross-region replication can be restarted from the beginning (i.e., fresh restart) without waiting for its unused objects in the Object Store to be deleted by utilizing a generation number associated with each object to delete the unused objects in a background process while allowing deleting processed objects as normal for the freshly restarted cross-region replication.

Embodiments are directed to a file system that include object stores. An object store for write requests may be provided. Write ahead log (WAL) entries that include data blocks may be generated. A WAL object may be generated based on the WAL entries and stored in the object store. An in-memory overlay may be updated to associate the data blocks with the WAL object. A checkpoint operation may be executed to: generate an index object that includes index entries that associate other data blocks with data objects stored in the object store; update the index object to include index entries that associate the data blocks with the WAL object; store the updated index object in the object store; update the in-memory overlay to remove the association of the data blocks and the WAL object and update the in memory WAL to remove records of successfully checkpointed WAL objects.

Embodiments are directed to a file system that include object stores. An object store for write requests may be provided. Write ahead log (WAL) entries that include data blocks may be generated. A WAL object may be generated based on the WAL entries and stored in the object store. An in-memory overlay may be updated to associate the data blocks with the WAL object. A checkpoint operation may be executed to: generate an index object that includes index entries that associate other data blocks with data objects stored in the object store; update the index object to include index entries that associate the data blocks with the WAL object; store the updated index object in the object store; update the in-memory overlay to remove the association of the data blocks and the WAL object and update the in memory WAL to remove records of successfully checkpointed WAL objects.

A system and method for cybersecurity inspection of private software registries is presented. The method includes: deploying an inspection broker in a computing environment, the inspection broker configured to communicate with a private registry of the computing environment; configuring the inspection broker to access the private registry for a list of objects stored in the private registry; selecting an object from the private registry for cybersecurity inspection; inspecting the object for a cybersecurity object in the computing environment; generating an inspection result based on detection of the cybersecurity object; sending the inspection result to an inspection environment, the inspection environment including a representation of the computing environment; and initiating a mitigation action based on the inspection result, the mitigation action generated in response to an instruction from the inspection environment.

The invention belongs to the technical field of distributed storage, and discloses a double-layer extensible cache system and method oriented to a separated memory, the system comprises at least one computing server CS and a memory resource pool formed by at least one memory server MS, and each CS and the memory resource pool are interconnected through RDMA; a cache CiCS used for sharing cache objects for all clients running in the CS is constructed in each CS, a cache CiMS used for storing the cache objects is constructed in the memory resource pool, and all the clients running in all the CSs can access all the cache objects stored in the CiMS; the CiCS can accelerate the access of the CiMS, and the CiMS can accelerate the access of the underlying storage system. In addition, the dynamic expansion and elasticity of the cache system are realized according to actual requirements, and the cache service does not need to be paused or the performance is not obviously degraded. According to the invention, the performance and the expansibility of the double-layer extensible cache of the separated memory are improved.

An intelligent assistant incorporating a Large Language Model (LLM) can transform a transcript containing communications regarding tasks into structured data. The transcript can be a meeting transcript or a transcript of a chatbot chat that was autonomously initiated by the intelligent assistant to obtain additional information regarding a task. With LLM assistance, the intelligent assistant transforms unstructured communication data from the transcript into structured data which is then assigned to relevant task objects stored in a database. Prior to processing a transcript, personal data therein can be sanitized, and the intelligent assistant can divide the transcript into smaller segments which each encapsulate a discussion of a different topic.

Techniques are provided for modifying a read path to process read operations during a storage operation, such as an operation to migrate objects storing data of a volume. The objects are stored across a storage tier and capacity tier of a source object store. As part of migrating the volume to a destination object store, the objects are migrated to the destination cluster. Directly copying the objects involves multiple read operations to the source object store and a write operation at the destination object store. The techniques provided herein improve the efficiency of the migration by initially sending metadata from the source object store to the destination object store for performing backend block copy operations to migrate the volume.

In some implementations, a storage node receives data processing instructions from a compute node of a network architecture. The storage node detects a Directed Acyclic Graph (DAG) within the data processing instructions. The DAG includes a plurality of data processing operations arranged within the DAG according to an execution. The data processing operations further include user-defined function (UDF) information associated with a UDF. The storage node may retrieve a first data object from an object store of the distributed storage node based on object keys information within the plurality of data processing operations. The storage node may execute the plurality of data processing operations using the retrieved first data object to generate a DAG execution result, the executing of the plurality of data processing operations based on the execution order. The storage node may communicate the DAG execution result to the compute node in response to the data processing instructions.

Managing access to stored objects includes receiving, by a storage OS in a computing system, an access key identifier (ID) and access key associated with a user of an object storage service (OSS); determining, by a directory service, whether the user is a member of a group authorized to access a storage object in at least one of a network accessible storage (NAS) volume and an OSS bucket, based at least in part on the access key ID; in response to the user being a group member, attempting to authenticate the user by the storage OS with the directory service based at least on the access key ID and the access key; and in response to the user being authenticated by the directory service, allowing, by the storage OS, access by the user to the storage object stored in at least one of the NAS volume and the OSS bucket.

A unified security agent manager plugin within a virtual machine compute instance manages at least one agent installed within the compute instance of a cloud environment. The plugin periodically receives agent inventory information, where the agent inventory information identifies (i) a plurality of platform types of the agent, and (ii) for each platform type, one or more deployable versions of the agent. The plugin selects a platform type from the plurality of platform types. The plugin compares the one or more deployable versions corresponding to the selected platform type with a version of the agent currently installed in the compute instance. If the version currently installed in the compute instance is older than the one or more deployable versions, the plugin fetches an agent object corresponding to a deployable version from an object storage repository, and updates the version currently installed in the compute instance to the fetched deployable version.

In some examples, a first computing system receives a first metadata change made to metadata of a first instance of an object stored at a storage location of the first computing device. The first computing system associates, with the first metadata change, a time of the first metadata change. Based on receiving replication of a second instance of the object from a second computing system, the first computing system determines that a second metadata change was made to metadata of the second instance of the object. Further, the second instance of the object includes a time of the second metadata change. The first computing system at least one of: resolves a conflict between the first metadata change and the second metadata change based at least on comparing the times, or merges the first metadata change with the second metadata change into the metadata for the object.

An object-based data storage system implemented by a computer for storing data in a plurality of objects (16A, 16B, 25A, 25B). The data storage system comprises a storage medium (80) configured to store said plurality of objects. Each one of the plurality of objects comprises a plurality of fields including a data field (18) configured for storing said data therein and, a separate object ID attribute field (17) configured for storing identification information associated with the object. The information stored within the object ID attribute field of at least one (16A, 16B) of the plurality of objects comprises metadata other than identification information associated with the at least one object. A processor is configured to access the at least one object (16A, 16B) from amongst the plurality of objects stored within the storage medium at least to retrieve information stored within an object ID attribute field (17) hereof thereby to retrieve the metadata.

Disclosed is a show case capable of managing and displaying objects stored therein. A show case according to one aspect of the present disclosure is a show case having an accommodation space in which an object is stored, and includes: a body; a moving body configured to form the accommodation space together with the body and including a transparent window; a blowing part configured to circulate air in the accommodation space; a first illumination configured to illuminate an object placed on a bottom surface of the accommodation space; a second illumination configured to illuminate a rear surface of the accommodation space; an input part to which an image of the object accommodated in the accommodation space is input; and a controller configured to recommend a type of second illumination to a user depending on the image input to the input part.

Techniques are provided for migrating a volume utilizing an object copy work queue and an object copy driver module. Data of the volume is stored within objects stored across a storage tier and capacity tier of a source object store. As part of migrating the volume to a destination object store, the objects are migrated to the destination cluster. Directly copying the objects involves multiple read operations to the source object store and a write operation at the destination object store. The techniques provided herein improve the efficiency of the migration by initially sending metadata from the source object store to the destination object store for performing backend object copy operations to migrate the volume. This results in fewer operations and less network usage, thus improving the efficiency and cost of migrating the volume.

The invention discloses a data recovery method and device and computing equipment, and belongs to the technical field of data security. The method is applied to a storage system for storing data by adopting a block-level storage mode. The method comprises the following steps: determining a target object of which data needs to be recovered; determining a first storage address of a data block for storing the target object in the first snapshot according to the first mapping relation set; and recovering the data of the target object according to the data stored in the first storage address in the first snapshot. Wherein the target object is any semantic-level data, a data block of the target object stored in a block-level mode is stored in the storage system, and the first snapshot is obtained after snapshot operation is executed on the data of the storage system at the first time; the first mapping relation set comprises the corresponding relation between the object maintained by the storage system after the first time and the storage address of the data block of the object. By means of the method, data recovery with semantic-level data as granularity can be achieved.

Embodiments of the present disclosure provide for improved identification of ownership and / or ownership lineage for a data repository, such as a shared file drive. Ownership data and / or ownership lineage data is identified based on data associated with the data repository itself and / or file data objects stored thereon in conjunction with data from a user linkage database. In this regard, accurate identification of a particular owner or owner(s) of a data repository may be determined from the data repository, and the user linkage database may serve additional details of such owner(s), linkages to other user(s) and / or group(s) of users embodying owner(s), and / or the like. Identified ownership data and / or ownership lineage data may be used for a myriad of additional processes, such as to notify users, determine what data repositories to perform detailed, efficient scans of based on group membership of the owner of said data repositories, or the like.

A system stores multiple documents in a log-structured object store, each document associated with a sequence number and a document value. The log-structured object store includes multiple log segments, each storing documents within a defined sequence number range. A first log-structured merge-tree is maintained to map document keys to corresponding sequence numbers, while a second log-structured merge-tree maps sizes of stale documents to their sequence numbers. A ratio is determined between the size of stale documents and the total size of documents in at least one log segment. In response to the ratio exceeding a predetermined threshold, a compaction operation is initiated to delete stale documents and consolidate active documents into a reduced number of log segments using the reclaimed space. The first and second log-structured merge-trees are updated based on the compaction results to reflect the current state of the data.

Techniques are provided for a data format for efficient management of checkpoint support. The data format corresponds to a base metafile and a set of instance metafiles used to track storage operations such as a directory restore operation. The base metafile and the set of instance metafiles can be used to resume the storage operation from where the storage operation left off in the event of a failure. The base metafile and the set of instance metafiles can be used to track progress of the storage operation processing objects stored within an object store of a cloud storage environment.

Techniques are provided for migrating a volume utilizing an object copy work queue and an object copy driver module. Data of the volume is stored within objects stored across a storage tier and capacity tier of a source object store. As part of migrating the volume to a destination object store, the objects are migrated to the destination cluster. Directly copying the objects involves multiple read operations to the source object store and a write operation at the destination object store. The techniques provided herein improve the efficiency of the migration by initially sending metadata from the source object store to the destination object store for performing backend object copy operations to migrate the volume. This results in fewer operations and less network usage, thus improving the efficiency and cost of migrating the volume.

A service migration technique moves (migrates) a snapshot storage service of an archival storage system from a primary site to a secondary site in accordance with a planned failover event. The snapshot storage service is configured to provide storage and retrieval of large amounts of snapshots (e.g., recovery points) of application workloads stored as objects on one or more buckets of an object store. As part of finalization of the recovery points (RPs) at the primary site, the snapshot storage service stores snapshot data and metadata of the RPs (e.g., as service state) in the object store. The snapshot storage service may then be migrated to the secondary site, wherein migration involves terminating the service at the primary site and instantiating the service at the secondary site. The instantiated storage service instance may then rebuild its service state from the object store, and resume storage and retrieval operations directed to RPs serviced by the instance.

A system and method for implementing an objects browser is disclosed. The system and method include receiving a request through the objects browser of a first object store to perform an operation on either the first or a second object store. The first and second object stores are part of a federated namespace. The system and method further include making an API request to an objects server, determining whether the API request is to access the first object store or the second object store, and providing access to the first object store responsive to determining that the API request is to perform the operation on the first object store or route the API request to the second object store to perform the operation on the second object store responsive to determining that the API request is to perform the operation on the second object store.

Techniques are provided for object store mirroring. Data within a storage tier of a node may be determined as being data to tier out to a primary object store based upon a property of the data. A first object is generated to comprise the data. A second object is generated to comprise the data. The first object is transmitted to the primary data store for storage in parallel with the second object being transmitted to a mirror object store for storage. Tiering of the data is designated as successful once acknowledgements are received from both the primary object that the first object was stored and the mirror object store that the second object was stored.

Embodiments provide for integrating custom content object repositories within a website building system. In some embodiments, a content object selection interface is generated comprising a plurality of candidate content objects selected based at least in part on a website identifier and one or more website editing historical interactions. The content object selection interface is rendered via a first computing device associated with an editing user identifier. Using a trained customization model and based at least in part on the editing user identifier, one or more selected candidate content objects are transformed into a custom contextualized content object. The custom contextualized content objects are added to a custom content object repository associated with the website identifier.

Input and output (I / O) to an object storage service is modified by implementing one or more owner-specified functions on I / O requests. A function may implement data manipulation, such as filtering out sensitive data prior to reading or writing the data. The function may be applied prior to implementing a requesting method (e.g., GET or PUT) specified within the I / O request such that the data to which the method is applied may not match an object specified in the request. For example, a user may request to obtain a data set (e.g., GET). The dataset may be passed to a function that filters sensitive data from the dataset, and then the GET request method may be applied to an output of the function. In this manner, an owner of an object on an object storage service is provided with greater control of objects stored at or retrieved from the service.

A processor and a memory communicatively coupled to the processor can be configured to synchronize objects stored with authoritative objects stored by an authoritative server. The memory can store the objects. Synchronizing the plurality of objects can include sharing metadata corresponding to the plurality of objects with the authoritative server, determining which of the objects stored in memory to update in response to sharing the metadata with the authoritative server, and updating at least one of the objects stored in the memory in response to determining that the at least one object may need to be updated.

Provided is a management assistance system capable of saving man-hours and improving safety in construction or civil engineering works by the worker. The system contains a database that stores attribute information for BIM or CIM; a plurality of target markers attached to specific structures; a mobile robot structured to patrol a yard of the building or the civil engineering structure, and to scan the periphery with a scanner, thereby acquiring three-dimensional point cloud data; and a computer apparatus structured to recognize position and posture of the specific structures having the target markers detected by analyzing the point cloud data, and, if the identification information of the target markers acquired by the computer apparatus is corresponded to an existing object stored in the database, the information regarding the existing object is updated with reference to the position and the posture of the specific structure recognized by the computer apparatus.

An inventory control system includes an object storage device, a display device, and one or more processors. The object storage device includes a plurality of compartments, where each compartment has a plurality of storage locations for storing objects. The display device is configured to display information about the object storage device. The one or more processors are configured to establish a database of descriptions for a plurality of objects configured for storage in the inventory control system. The one or more processors retrieve a plurality of object keywords corresponding to a plurality of objects stored at a plurality of storage locations within one of the plurality of compartments. The one or more processors also generate a text block based on the retrieved plurality of object keywords. On the display device, the one or more processors display a representation of the plurality of compartments of the object storage device with the text block applicable to the one of the plurality of compartments.

A solution for transforming and managing data in a data lake environment is disclosed. A definition of a transformation stream is received via a graphical user interface. The transform stream specifies an operation to transform source data into target data stored in the first format object store. And generating a virtual process corresponding to the transformation stream and storing the virtual process in a memory cloud database. A virtual process is then executed such that metadata is retrieved from the first format object store and a transform job is triggered on the compute cluster. The transform job reads the source data from the first format object store, applies one or more transforms specified in the definition of the transform stream, and writes the result to the target data in the first format object store.

The invention discloses a control method and device of storage equipment and the storage equipment, and belongs to the field of storage equipment. The control method of the storage equipment comprises the following steps: acquiring time information of storing each storage object in a target chamber in at least one chamber to the storage equipment and position information of the storage object in the target chamber; generating a first image corresponding to the target chamber based on the time information, the position information and the storage capacity information corresponding to the target chamber; and generating and displaying a second image based on the first image. According to the control method of the storage equipment, the second image used for representing the storage condition of each chamber is generated according to the time information of each storage object stored in the storage equipment in the chamber and the position information of the storage object in the chamber, the number of the storage objects stored in each chamber, the storage duration and other conditions can be visually displayed, and the storage efficiency of the storage equipment is improved. And the real-time performance is high, and the user can conveniently manage the storage equipment, so that the use experience of the user is improved.