144 results about "Cloud storage system" patented technology

The invention particularly relates to an object storage data encryption method based on a large model. According to the object storage data encryption method based on the large model, user data is partitioned and compressed, and a deep learning large model is trained by using historical data accumulated by a cloud storage provider and known security threats; according to a large model prediction result, selecting an optimal encryption algorithm and a key management strategy; encrypting the preprocessed data, and storing the encrypted data and metadata in a cloud storage system; and when the user needs to access the data, reading the metadata, obtaining the decryption key, and recovering the original data. The object storage data encryption method based on the large model is efficient, safe and flexible, the optimal encryption strategy can be intelligently selected according to changes of data characteristics and the safety environment, dynamic encryption is achieved, therefore, the safety and privacy of data are remarkably improved, and the requirements of a modern object storage system can be met.

According to the agriculture-like cultivated land and land humidity monitoring robot and the monitoring method, structurally, a soil turning device, a soil extraction device and a driving wheel device are connected with a driving motor, the driving motor, a camera device and the soil extraction device are in signal connection with a remote control terminal, and the soil turning device is arranged in a front-back telescopic and up-down movable mode relative to a machine body; the soil extraction device is movably arranged up and down relative to the machine body, the camera device is rotationally arranged relative to the machine body and used for monitoring the movement of the robot in real time, and by optimizing robot hardware configuration and sensor layout and integrating multiple sensors and a core control unit, comprehensive and accurate collection of farmland soil key parameters is achieved. And a wireless data transmission and cloud storage system is deployed to ensure real-time and accurate transmission and analysis of data. Artificial intelligence and computer vision technologies are integrated, soil images are processed, features are extracted and classified, and accurate evaluation and prediction of soil quality are achieved.

The invention discloses a cloud storage image privacy protection encryption method based on cross-plane dynamic grouping, and belongs to the technical field of information security and cloud storage. The method comprises the following steps: acquiring an image in a cloud storage environment, and preprocessing the image; encrypting the image by adopting a dynamic grouping cross-plane encryption method; constructing a ciphertext image structure containing permission labels and visual adjustment information and a data packet used for realizing access control and semantic hierarchical display; and uploading the ciphertext information to a cloud storage system through a secure transmission protocol. According to the method, dynamic grouping cross-plane encryption is adopted, so that the security of the encrypted image is improved, and security vulnerabilities caused by a fixed grouping mode are avoided; in combination with cloud storage, data access and authority control are adaptively optimized, so that different users can access corresponding encrypted data according to authorization levels, and the adaptability of the encryption method is improved; the effectiveness of local disturbance is improved through dynamic grouping, large information leakage is effectively avoided, and the data security is improved.

The invention discloses a metadata version control and consistency verification method and system, and belongs to the technical field of distributed system metadata management, the method comprises the steps of version tree construction, version query and backtracking, version merging and conflict processing, the version tree construction takes an initial timestamp associated with an initial version of metadata as a root node of the version tree; whenever the metadata is changed, a unique timestamp is generated for the changed metadata; carrying out associated storage on the generated timestamp and the changed metadata; and creating a new node according to the newly generated timestamp, establishing a father-son relationship between the new node and the node of the previous version to form a branch structure of the version tree, and arranging the nodes in the version tree according to the sequence of the timestamp. According to the method, the management efficiency of multi-version metadata can be remarkably improved, the data integrity and consistency are effectively guaranteed, and the method is suitable for cloud storage system metadata management, cross-platform metadata migration and other scenes.

The invention discloses a data recovery method, electronic equipment and a computer readable storage medium, and the method is applied to a cloud storage system, and comprises the steps: obtaining data traffic information of the cloud storage system in a current time period, predicting data traffic in a future time period based on the data traffic information, obtaining a data traffic prediction result, and outputting the data traffic prediction result. Determining data recovery time matched with the data traffic prediction result; determining a data recovery bandwidth based on the data traffic prediction result and load information corresponding to the cloud storage system; and in response to data loss of the cloud storage system, performing data recovery on the cloud storage system based on the data recovery time, the data recovery bandwidth and the load information corresponding to the cloud storage system. According to the scheme, the reasonability of data recovery can be improved.

The disclosure relates to a method for streamlining baggage screening across modes of transportation. The method includes scanning a baggage item at an airport and uploading scanned baggage imagery of the contents and license plate identification to a secure cloud storage system. A screening manifest is generated which lists an additional mode of transportation requiring different screening rules. The contents of the stored baggage imagery are reanalyzed according to these different rules and regulations, to determine compliance, and creates a baggage authorization record. Based on the compliance result, represented by an indicium affixed to the baggage, a trusted custody handler can directly deliver the baggage to the next mode of transportation without additional screening, or direct it for further security screening if non-compliant. This system improves efficiency and security in multi-modal transportation networks.

The invention relates to the technical field of cloud storage, and discloses a block chain enabled cloud storage data integrity verification method, which comprises the following steps of performing hash value calculation on a plurality of data blocks in cloud storage, and constructing a Merkle tree based on the hash values to generate a root node hash value for data integrity verification; after the root node hash value is generated, sparse sampling is carried out on the hash value set by using a compressed sensing technology, and sampled data is restored through a sparse recovery algorithm; the invention also discloses a block chain enabled cloud storage data integrity verification system. The system comprises a hash processing module; a sampling reconstruction module; an optimization decision module; and a verification execution module. According to the method, the compressed sensing technology, the Pareto optimal strategy and the block chain technology are combined, efficient, low-resource-consumption and intelligent data integrity verification is achieved, the delay and calculation burden of the verification process are optimized, and the performance and reliability of the cloud storage system are improved.

Embodiments of the present disclosure provide a cache type cloud storage system, a data reading and writing method, a device, a storage medium, and a program product. The embodiments of the present disclosure provide a high-performance and highly elastic cache type storage disk, allowing a user to mount and use the cache type storage disk on any computing node, and supporting a storage-compute separation architecture, such that elastic resource scaling can be realized, reducing the idle waste of computing and storage resources. In addition, using a one-hop data reading and writing protocol to directly read and write at storage nodes helps to reduce the delay of data reading and writing. Meanwhile, data is stored in shards, and each data shard is stored on at least two storage nodes to achieve redundant storage of replicas. Compared with a local disk, the cache type storage disk has higher data reliability and availability, making data calculation and analysis more cost-effective and providing better user experience.

Provided in the embodiments of the present disclosure are a cloud storage system, a data read / write method, a device, a storage medium, and a program product. In the embodiments of the present disclosure, provided is a highly available cross-availability-zone cloud storage disk. On the basis of cross-availability-zone disaster recovery requirement information, data storage layout information for the cloud storage disk is generated, and on the basis of the data storage layout information, a data read / write operation is performed on persistent storage nodes across availability zones. The data storage layout information can embody a multi-copy and erasure coding fused redundant storage method, which is used by the cloud storage disk, and by means of which data storage is highly available across availability zones, so as to reduce a data redundancy ratio; furthermore, a better read / write performance is provided and elastic requirements for availability zones are met, a cross-availability-zone network bandwidth is reduced, and the storage cost is reduced.

The invention provides an industrial machine platform production material cloud synchronization method and system, and the method comprises the steps: firstly collecting a local production material set in a current production period of an industrial machine platform, obtaining a generation timestamp and an associated process identifier of each material unit, combing the relevance through a local processing module, and generating a structured production material unit; the structured production data unit is sent to a cloud coordination node, historical production data version sequences are called and compared, data version evolution characteristics are generated, and a dynamic synchronous execution scheme is determined based on the data version evolution characteristics and network transmission state parameters; and finally, transmitting the structured production data unit to a cloud storage system for incremental updating according to the dynamic synchronous execution scheme, generating a synchronization result, and feeding back the synchronization result to the industrial machine, thereby realizing real-time and efficient cloud synchronization of the production data of the industrial machine.

Provided in the embodiments of the present disclosure are a cloud storage system, a data read-write method, a device, and a storage medium. Provided in the embodiments of the present disclosure is a general-purpose hierarchical encryption solution concerning cloud storage, which solution can uniformly meet the requirements in terms of data encryption and decryption and key management. By means of layering a cloud storage system, data encryption and decryption and key management processes are coordinated and unified; on a customer interaction layer and a storage service layer, a customer master key and a storage service key are used to cooperate with each other to perform key management, and on the storage service layer and a storage persistence layer, the storage service key and a data encryption key are used to cooperate with each other to control the data encryption and decryption process; and a key management function is decoupled from a data encryption and decryption function, thereby improving the flexibility and expandability. Furthermore, the storage service layer can directly reuse an encryption capability provided by a data persistence layer, such that it is not necessary to encrypt data multiple times on each layer, thereby reducing the encryption cost.

A central node can: receive a query comprising at least one parameter comprising a time range of a dataset stored in a cloud storage system; transmit one or more of the query parameters comprising the time range to a metadata service; receive from the metadata service a list of files related to the query; and assign to each processing node of a plurality of processing nodes a subset of the files. Each processing node can: determine that the subset is not stored on a cache; retrieving the subset not stored on the cache from the cloud storage system; store the retrieved subset in a local memory; scan the subset stored in the local memory for data matching the at least one parameter to generate a subset of query results; and concurrently copy using a separate thread from the scanning, the subset stored in the local memory to the cache.

Systems and methods are described for a cross-site high availability distributed storage system. According to one embodiment, a computer implemented method includes providing a remote direct memory access (RDMA) request for a RDMA stream, and generating, with an interconnect (IC) layer of the first storage node, multiple IC channels and associated IC requests for the RDMA request. The method further includes mapping an IC channel to a group of multiple transport layer sessions to split data traffic of the IC channel into multiple packets for the group of multiple transport layer sessions using an IC transport layer of the first storage node and assigning, with the IC transport layer, a unique transaction identification (ID) to each IC request and assigning a different data offset to each packet of a transport layer session.

The invention discloses a camera potential safety hazard patrol identification method based on video frame image segmentation, and belongs to the technical field of image processing. The method comprises the following steps: acquiring data through a video cloud storage system, classifying the data to form a basic data pool, and selecting a target video source set by combining a daily safety patrol mechanism and a special safety patrol mechanism; a region growing algorithm and a U-Net network are adopted to carry out image segmentation and feature extraction, and judgment and recognition operations are executed based on different selection mechanisms. And meanwhile, dynamically evaluating and updating a potential safety hazard list item and an easy-to-occur time period, generating a potential hazard report record and optimizing a patrol strategy. According to the invention, potential safety hazards in the construction environment of the construction site can be comprehensively and automatically identified, and the early warning accuracy and efficiency are improved.

The invention discloses a medical image data processing system, an information processing method, equipment and a medium, and relates to the technical field of data processing, and the system comprises a cloud server which is used for carrying out the model optimization training of an initial fracture region recognition model through the medical image training data in a cloud storage system, and obtaining a pre-trained fracture region recognition model, deploying the pre-trained fracture region recognition model to an edge computing device; the medical scanning imaging equipment is used for collecting a to-be-detected image of a to-be-detected part of the target object; and the edge computing device is used for receiving the to-be-detected image sent by the medical scanning imaging device through a locally deployed pre-trained fracture region recognition model, performing reasoning detection on the fracture region in the to-be-detected image based on local computing power resources, and outputting a target detection result containing fracture region position information. Model training is achieved through the cloud layer, deployment and use of a lightweight model are achieved through the edge layer, and accurate processing of medical image data is completed through a small number of local resources.

The invention discloses a distributed cloud storage system for credible storage of bulk transaction data, which comprises a three-layer hybrid architecture and a core function module for cooperative work, and has the functions of credible storage, privacy protection and cross-mechanism verification of the full life cycle of the bulk transaction data. According to the system, through innovative hybrid architecture design and core technology research and development, the core goal of storing hash on a chain and storing original under the chain is achieved, it is guaranteed that data cannot be tampered in the whole life cycle, meanwhile, it is guaranteed that data sovereignty belongs to enterprises, the cross-mechanism verification efficiency is improved, the operation cost is reduced, and solid technical support is provided for bulk commodity transaction digitization.

The invention discloses a secure data sharing caching system and method based on a block chain and a named data network. The system comprises five core components, namely a terminal node, an edge node, a credible authorization node, a cloud storage system and a block chain platform, and safe and credible data sharing is realized by fusing a decentralized trust mechanism of a block chain and an efficient data distribution capability of a named data network. The system adopts a terminal-edge-cloud storage system three-layer architecture, and ensures that data transaction is real and traceable in combination with multi-level identity authentication and a reputation mechanism; automatic management is realized through an intelligent contract, and data privacy is protected by utilizing multi-level authority management; and the system performance is improved by a node weight-based clustering method and a collaborative caching strategy. According to the method, the problems that in an existing data sharing system, the data authenticity is difficult to guarantee, a privacy protection mechanism is imperfect, and the system expandability is limited are solved, and the safety, efficiency and expandability of data sharing are remarkably improved.

The invention provides a distributed multi-site operation cloud storage system, which comprises a data management module used for being responsible for storage, retrieval and copy management of data and ensuring the integrity and availability of the data; the storage pool management module is used for managing resources of a storage pool; the copy distribution module is used for automatically calculating a placement rule of a data copy and realizing distributed storage of data; the network scheduling module is used for transmitting and scheduling data in a cross-machine-room network; the fault detection module is used for monitoring the running state of the storage system, detecting faults and abnormal conditions, and giving an alarm and processing in time; and the arbitration module is used for being responsible for decision judgment and brain split prevention in a fault scene, and ensuring data consistency and system stability. The invention provides a distributed multi-site operation cloud storage system which solves the problem that once a machine room goes wrong, the whole cloud platform and a business application system borne by the cloud platform are both in an unavailable state.

A system and method for inspecting virtual instances in a cloud computing environment for cybersecurity threats utilizing disk cloning is presented. The method includes: selecting a virtual instance in a cloud computing environment, wherein the virtual instance includes a disk having a disk descriptor with an address in a cloud storage system; generating an instruction to clone the disk of the virtual instance, the instruction when executed causes generation of a cloned disk descriptor, the cloned disk descriptor having a data field including the address of the disk of the virtual instance; inspecting the cloned disk for a cybersecurity threat; and releasing the cloned disk in response to completing the inspection of the cloned disk.

Systems and methods include pre-processing documents in cloud storage using query embeddings, providing personalized prompts to users based on documents in cloud storage, real-time anticipation of user interest in information contained in documents in cloud storage, and providing generative answers including citation to source documents in cloud storage. The system and methods generate generative machine learning model (MLM) prompts based on document portions of documents in a cloud-based content management platform. The systems and methods use the generative MLM to generate responses to prompts, and the responses include citations to the document portions used to generate the responses in order for users to verify the responses.

To streamline volume restoration. [Solution] The device for managing the storage system includes a processor and a storage device for storing a backup management model, the backup management model includes information on the snapshot generation of a volume stored in the restore destination storage system and information on the snapshot generation of the volume stored in the cloud storage system, and the processor refers to the backup management model and selects the restore source for each snapshot generation to be used for restoring a specified generation in the restore destination storage system from the restore destination storage system and the cloud storage system.

A content distribution facilitation system is described comprising configured servers and a network interface configured to interface with a plurality of terminals in a client server relationship and optionally with a cloud-based storage system. A request from a first source for content comprising content criteria is received, the content criteria comprising content subject matter. At least a portion of the content request content criteria is transmitted to a selected content contributor. If recorded content is received from the first content contributor, the first source is provided with access to the received recorded content. The recorded content may be transmitted via one or more networks to one or more destination devices. Optionally, a voice analysis and / or facial recognition engine are utilized to determine if the recorded content is from the first content contributor.

Provided in the embodiments of the present disclosure are a data storage method, a data reading method, a device, a system, a storage medium and a program product. In the embodiments of the present disclosure, introducing a second buffer pool between a first buffer pool and a persistent storage medium of a storage node allows more data objects to be located in the buffer pools, fully exerting the read-write performance advantages that the buffer pools bring to a cloud storage system. Further, by means of compressing data and then storing same in the second buffer pool, more data can be stored with limited second buffer pool resources, thereby further improving the hit rate when searching for data in the buffer pools, further exerting the effect of the buffer pools, improving the performance of the cloud storage system, and reducing storage cost.

A system includes a key service, that is configured to authenticate requests from an external manufacturing system (“EMS”), receive a request for generating a keyset, generate the keyset, send the keyset to the EMS, and send the keyset to a persistent cloud storage system, wherein an external cloud system accesses the keyset for use in secure communication with a hardware device.

The embodiment of the invention provides a data storage and reading method, device and system, a storage medium and a program product. In the embodiment of the invention, the second cache pool is introduced between the first cache pool and the persistent storage medium of the storage node, so that more data objects can be located in the cache pool, and the read-write performance advantage brought to the cloud storage system by the cache pool is fully exerted; furthermore, the data is compressed and then stored in the second cache pool, so that more data can be stored by using limited resources of the second cache pool, the hit rate when the data is searched from the cache pool is further improved, the effect of the cache pool is further played, the performance of the cloud storage system is improved, and the storage cost is saved.

According to one embodiment, a computer implemented method comprises providing multiple channels between a first storage node and a second storage node with each channel having a separate network connection for packets of a transport layer session, assigning packets from each channel to a group of receive queues of the second storage node, continuously monitoring whether two or more channels of the multiple channels share a same receive queue of the second storage node, and sending a communication via a channel to the first storage node to indicate a dynamic change in a hash input field (e.g., a source port, a destination port, a source internet protocol (IP) address, and a destination IP address) when two or more channels of the multiple channels share a same receive queue of the second storage node.

The embodiment of the invention relates to the technical field of network security, provides a cloud storage data integrity auditing method, designs an extensible dynamic hash tree structure based on an extensible tree thought in the field of load balancing, can be suitable for common access imbalance scenes in cloud storage scenes, and improves the auditing efficiency. The dynamic Hash tree structure is beneficial to reducing performance waste caused by data verification, and on the basis of the dynamic Hash tree structure, a data integrity auditing scheme is provided by utilizing path proof, so that the cloud storage system has high efficiency and reliability at the same time.

The application discloses a data storage method, system and device, a storage medium and a program product, and belongs to the field of computer data processing. The method comprises the following steps: receiving distributed storage data sent by an execution node, wherein the distributed storage data is data stored by the execution node in a distributed storage manner; transferring the distributed storage data to a local disk for storage, wherein the local disk is a local storage area corresponding to the current device; in response to the local disk meeting data uploading conditions, uploading local storage data in the local disk to a cloud storage system according to a preset uploading strategy, wherein the preset uploading strategy is a strategy determined based on the average file size in the local disk; and in response to the uploading of the local storage data being completed, cleaning the local storage data from the local disk. The method achieves the effect of cooperation between local storage and the cloud storage system, and solves the problem that the large data workload cannot be effectively deployed in an offline hybrid cluster due to the fact that storage and calculation cannot be separated.

The invention discloses a system and a method for automatically collecting multi-type remote sensing satellite image data into a cloud, and relates to the technical field of remote sensing satellite image data collection. The system comprises a data acquisition module, a cluster DB module, a data processing module, a COG folder module, a data cloud storage module and the like, metadata information of image data is pulled, metadata is analyzed by Agent, a metadatabase table is obtained, the image data at a specified position is read according to the metadatabase table, and the image data is stored in the cloud after being processed and subjected to COG conversion. The system can automatically collect and store multi-type remote sensing satellite image data in the cloud in a timed or real-time manner, and can realize dynamic capacity expansion of a storage cluster according to the real-time data size to meet the collection rate requirement.

The invention provides a data integrity verification method and system oriented to an industrial cloud storage system, and the method comprises the steps: a plurality of cloud computing servers receive a secret sharing share from a fog node, and filter the secret sharing share based on additional commitment and proof; the secret sharing share is calculated based on a randomly selected signature secret key; a plurality of cloud computing servers receive the data file and execute blocking, calculate the data labels of the data blocks based on the secret sharing share, and integrate the data labels of all the data blocks after the data file is blocked to obtain a label set of the data file; the main cloud computing server sends the data file and the label set thereof to a cloud storage provider for storage; the verification comprises the following steps: the third-party auditor sends random challenge information to the cloud storage provider, and then the cloud storage provider generates an integrity proof of the data file; and the third-party auditor receives the integrity proof of the data file and checks the validity of the integrity proof to obtain an integrity verification result of the data file.