2597results about How to "Improve storage efficiency" patented technology

A filesystem-aware storage system locates and analyzes host filesystem data structures in order to determine storage usage of the host filesystem. To this end, the storage system might locate an operating system partition, parse the operating system partion to locate its data structures, and parse the operating system data structures to locate the host filesystem data structures. The storage system manages data storage based on the storage usage of the host file system. The storage system can use the storage usage information to identify storage areas that are no longer being used by the host filesystem and reclaim those areas for additional data storage capacity. Also, the storage system can identify the types of data stored by the host filesystem and manage data storage based on the data types, such as selecting a storage layout and / or an encoding scheme for the data based on the data type.

An integrated VoIP unified message processing system includes a voice platform that processes data in native VoIP format. There is no use of hardware telephone interface cards (TICs) or software transcoding to transform data to PCM or other formats. Cost reductions are achieved by the elimination of expensive dedicated hardware and scalability is achieved by obviating the need for software transcoding.

Embodiment provide a surveillance camera adapted to be connected to an internet protocol network, the surveillance camera including at least one facial processor, at least one facial recognition algorithm embodied in suitable media, at least one facial recognition algorithm executable with digital format image data by at least one facial processor detecting faces, execution of at least one facial recognition algorithm producing unique facial image data, execution of at least one facial separation algorithm producing facial separation data, at least one facial processor in communication with at least one facial signature database to obtain reference data, execution of at least one facial signature algorithm comparing facial separation data and reference data to identify correlations, at least one compression algorithm producing compressed image data, and a network stack configured to transmit to the network unique facial image data for each detected face and compressed image data.

A system and method for dynamic data recovery is described. The system and method for dynamic data recovery operates on a computer storage system that includes a plurality of disk drives for storing parity groups. Each parity group includes storage blocks. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity set reside on the same disk drive. The computer storage system further includes a recovery module to dynamically recover data that is lost when at least a portion of one disk drive in the plurality of disk drives becomes unavailable. The recovery module is configured to produce a reconstructed block by using information in the remaining storage blocks of a parity set that corresponds to an unavailable storage block. The recovery module is further configured to split the parity group corresponding to an unavailable storage block into two parity groups if the parity group corresponding to the unavailable storage block spanned all of the drives in the plurality of disk drives.

A filesystem-aware storage system locates and analyzes host filesystem data structures in order to determine storage usage of the host filesystem. To this end, the storage system might locate an operating system partition, parse the operating system partion to locate its data structures, and parse the operating system data structures to locate the host filesystem data structures. The storage system manages data storage based on the storage usage of the host file system. The storage system can use the storage usage information to identify storage areas that are no longer being used by the host filesystem and reclaim those areas for additional data storage capacity. Also, the storage system can identify the types of data stored by the host filesystem and manage data storage based on the data types, such as selecting a storage layout and / or an encoding scheme for the data based on the data type.

The invention provides a generation method for consensus blocks in a block chain and a computing device. The method comprises the steps that nodes in a peer-to-peer network voluntarily register as candidate nodes; a selected node subset is formed by selecting nodes from in-network candidate nodes, and the nodes of the subset are randomly classified into accounting nodes and audit nodes; the accounting nodes package transactions in a transaction pool as candidate sub-blocks and broadcast the candidate sub-blocks to the audit nodes; the audit nodes verify all received candidate sub-blocks according to a preset audit rule, select an unique candidate sub-block, add audit stamps to the unique candidate sub-block and broadcast the unique candidate sub-block to other audit nodes; and when the number of the audit stamps of the candidate sub-block exceeds a preset threshold value, the candidate sub-block becomes the recorded selected block, so a consensus process is finished. According to the scheme provided by the invention, as improvement of the network performance, code and manual parameter change is avoided, the convergence speed of the consensus blocks is automatically improved, and the difficulty of DDOS (Distributed Denial of Service) and Eclipse attacks is greatly improved.

A method and apparatus are disclosed for increasing virtual storage capacity in on-demand storage systems. The method utilizes data compression to selectively compress data stored in a storage resource to reduce the utilization of physical storage space whenever such physical resources have been over committed and the demand for physical storage exceeds its availability. In one exemplary embodiment, the utilization of the capacity of a shared storage resource is monitored and data is selected for compression based on the utilization. The compression of the selected data is triggered in response to the monitoring results. In addition, policies and rules are defined that determine which data is selected for compression. For example, the selection of data may be based on one or more of the following: a degree of utilization of said capacity of said shared storage resource, a volume size of said data, an indicator of compressibility of said data, a frequency of use of said data, a manual selection of said data, and a predefined priority of said data. The disclosed methods improve the operation of virtual allocation by further enhancing the availability of physical space through data compression. Virtual allocation and block-based data compression techniques are utilized to improve storage efficiency with a minimal risk to system availability and reliability and with a minimal impact to performance (access time and latency).

An OLAP query processing method oriented to a database and Hadoop hybrid platform is described. When OLAP query processing is performed, the processing is executed first on a main working copy, and a query processing result is recorded in an aggregate result table of a local database; when a working node is faulty, node information of a fault-tolerant copy corresponding to the main working copy is searched for through namenode, and a MapReduce task is invoked to complete the OLAP query processing task on the fault-tolerant copy. The database technology and the Hadoop technology are combined, and the storage performance of the database and the high expandability and high availability of the Hadoop are combined; the database query processing and the MapReduce query processing are integrated in a loosely-coupled mode, thereby ensuring the high query processing performance, and ensuring the high fault-tolerance performance.

An application server disk image generating apparatus and method comprising a basic disk image generating component for generating basic disk images for basic programs used by the server; an incremental disk image generating component for generating incremental disk images including heritage relationship for other respective applications based on the basic programs used by the server; and an image profile generating means for generating an image profile for each of the basic disk images and the incremental disk images. By using the apparatus, the storage consumption can be decreased greatly and the storage efficiency can be improved. The invention also discloses an application server disk image management and distribution system to which the application server disk image generating apparatus is applied, and a system for provisioning the application server using disk images.

A memory cell array is logically divided into a plurality of regions having different reading speeds, the respective regions having the different reading speeds include region information storage regions for storing region information in which at least two addresses present in the memory cell at the same time are set to be different regions, a reading control circuit is constituted to carry out a reading operation by determining any of the divided regions which is to be read, selecting an optimum reading method and controlling the reading circuit based on the region information stored in the region information storage region, and an address which can be read in a short time in multivalued information stored in one memory cell is set to be a high speed reading region and is distinguished from regions having the other reading speeds. Consequently, it is possible to efficiently write and read information of 2 bits or more in one memory cell array without reducing a using efficiency of the memory cell array.

The invention discloses a quality safety tracing method for food processing enterprises. The quality safety tracing method includes the steps that a laser coder generates random tracing codes according to a coding rule when a laser marking machine in a production line device is dynamically read in an on-line tagging mode; the laser marking machine carries out tracing mode marking on products on a production line, and two-dimension codes and plain codes are all marked on packages; a fixed reader is used for scanning and reading designated tagged code portions of the products; the two-dimension codes are successfully scanned and read, the tracing codes are recorded, and relevance between the tracing codes and commodity attribute information is completed; if the two-dimension codes fail to be scanned, the two-dimension codes will be removed through a removing device; the commodity tracing code information and the commodity attribute information are recorded into a relational database; after the products are packaged, package code data and product tracing code data are related; the products are stacked, stacking codes and tagged stacking codes are generated, and the stacking codes and the product package code data are related; the stacking codes are scanned, storage of the products is completed, delivery orders and the stacking codes are scanned to complete delivery, and the database records delivery information.

An automatic warehouse 1 includes a plurality of shelves 50 and a conveyance device 20. The plurality of shelves 50 are arranged in a horizontal direction and in a single level or in a plurality of levels and adapted to store storage objects. The conveyance device 20 is adapted to transfer the storage objects between the same and each of the plurality of shelves 50. All of the plurality of shelves 50 are implemented by a plurality of shelves 50 provided in a plurality of carriages 60 capable of moving between the inside of the automatic warehouse and the outside of the automatic warehouse. By use of the plurality of carriages 60 which also function as storage shelves, there can be provided an automatic warehouse having high degree of freedom and good storage efficiency, enabling efficient use of factory space, and being capable of coping with cell production.

The invention discloses a tourism electronic contract digital storage system and a storage method based on a regional chain, which comprises an electronic contract signing system, an electronic contract service database, a block chain access interface, a distributed block chain network module and a signature storage system. The electronic contract signing system includes contract establishing module, contract changing module, contract approving module, tourist signing module and contract filing inquiry module. The signature storage system comprises a hash operation module, an electronic signature module, a block creation module and a block chain forensics module. Hash operation is carry out on that business data related to the electronic contract to form the hash value code certificate data; Signing and encrypting the generated hash value encoded certificate data combined with the operator private key of the related service; Distributed storage of hash value encoded certificate data iscarried out in the node of the area chain; The invention adopts the block chain technology, realizes the electronic management of the contract, realizes the zero loss of the electronic contract data,and ensures that the transmission process cannot be tampered with.

An assembly for promoting the growth of plant tissues that includes a plurality of plates each defining an array of wells wherein each of the wells contains a tissue sample. Support for the plates is provided by a rack having a plurality of vertically stacked shelves that may include one or more register depressions that urge the plates into predetermined positions. Light for the tissue samples is provided by a plurality of light-emitting diode arrays each mounted on a circuit board. Each circuit board is supported by a respective card edge connector of the rack so that the light-emitting diodes are in proximity to the plates supported on one of the shelves therebelow. Preferably, the light-emitting diode array corresponds to the well array supported in the registered position on the shelf therebelow so that each light-emitting diode is centered above a respective one of the wells.

A method for data backup including (a) forming an image of the storage device; (b) for each block to be backed up to the image, generating a hash; (c) for each block stored in the image, storing a hash in a hash table; (c) for each additional block of the storage device to be backed up, generating a hash; (d) sorting all the generated hashes and deleting duplicate hashes; (e) comparing the hashes to identify candidate blocks that might have identical contents with contents of blocks stored in the image; (f) if the hashes are not coincident, then backing up, to the image, contents of unidentified blocks and blocks that do not have identical hashes, and (g) otherwise, storing links in the image instead of the contents of the blocks, (h) after checking all the hashes for those blocks that need to be backed up, writing only unique hashes to the hash table; (h) links for multiple blocks with identical contents point to a single block in the image, (i) the image contains a bitmap of the backup; (j) the bitmap contains indicators for the links that define if a block contains the content or if the block points to another block, (k) also indicators that reflect used and unused blocks such that an indicator whether contents are shared with another block vs. contents are unique to every other block in the image.

A system and method for dynamic redistribution of parity groups is described. The system and method for dynamic redistribution of parity groups operates on a computer storage system that includes a plurality of disk drives for storing parity groups. Each parity group includes storage blocks. The storage blocks include one or more data blocks and a parity block that is associated with the data blocks. Each of the storage blocks is stored on a separate disk drive such that no two storage blocks from a given parity set reside on the same disk drive. The computer system further includes a redistribution module to dynamically redistribute parity groups by combining some parity groups to improve storage efficiency.

An energy storage system is provided which includes an electrolyser a hydrogen gas storage and a power plant. The electrolyser is connected to the hydrogen gas storage and the hydrogen gas storage is connected to the power plant. Furthermore, a method for storing and supplying energy is provided which includes delivering electrical energy to an electrolyser; decomposing water into oxygen and hydrogen gas by means of the electrolyser; storing the hydrogen gas; supplying the stored hydrogen gas to a power plant; and producing electrical energy via of the power plant.

The invention relates to a safety metadata management method based on integrality checking, belonging to the field of storage safety. The method is characterized in that a self encryption technology for file data is used at a client to encrypt the file data, thereby improving the storage efficiency; a 64-heap hash tree is used at a safety metadata management server end to maintain the hash value of a file block, thereby providing integrality protection on the hash value of the file data block and realizing the high-efficiency verification on the user's access to file and the high-efficiency data updating; and simultaneously a root hash virtual linked list technology is used, thereby ensuring the integrality of root hash values of multiple 64-heap hash trees belonging to one file and supporting the user's concurrent access to the file to a certain extent.

A dynamic caching technique adaptively controls copies of data blocks stored within caches (“cached copies”) of a caching layer distributed among servers of a distributed data processing system. A cache coordinator of the distributed system implements the dynamic caching technique to increase the cached copies of the data blocks to improve processing performance of the servers. Alternatively, the technique may decrease the cached copies to reduce storage capacity of the servers. The technique may increase the cached copies when it detects local and / or remote cache bottleneck conditions at the servers, a data popularity condition at the servers, or a shared storage bottleneck condition at the storage system. Otherwise, the technique may decrease the cached copies at the servers.

The invention discloses a snapshot storage and data recovery method of a continuous data protection system. In a block-level continuous data protection (CDP) system, each write operation of a disk data block has a CDP metadata for recording the write operation. The CDP metadata is taken as a chain table node, and besides a block number containing the data block, the node also sets up three fields of forward link, uplink and downlink. On the basis, a binary tree is constructed to record the table head of each key chain table node, thereby forming a key node set, and the chain table starting from the table heads can reflect the mapping relation from each block address of the disk of the current time to the log data block. The invention can store the mapping relation of the snapshot time by using less storage space, thereby supporting more intensive data snapshot and being beneficial to shortening the data recovery time.

The invention discloses an equipment cluster health state evaluation method based on industrial big data and solves a health state evaluation problem of equipment clusters. Based on the full service period big data environment of the equipment clusters, an entity state information slicing management model is constructed to pre-process data; a condition similarity clustering method is utilized to carry out equipment cluster division, a regression method is utilized to establish a mirror image model, the mirror image model and an entity health state are mutually mapped, and a health state quantification model of the different equipment clusters is acquired; fusion and reconstruction of the health state data of the different equipment clusters are carried out to acquire health degrees of the different pieces of equipment, fitting of an equipment health state degeneration curve is carried out, and residual service life of the equipment is predicted. The method is advantaged in that a big data clustering modeling method is utilized, not only can effectively different evaluation on the equipment cluster health state be carried out, but also model redundancy of cluster modeling can be reduced, the internal structure of the model is simplified, normal operation of the cluster equipment is guaranteed, and use values of the equipment can be mined to a maximum degree.

The invention discloses a deep-learning and cloud service-based face identification attendance system and method. The system comprises a face detection module, a data wireless transmission module, a cloud server and an attendance information management webpage, wherein the face detection module is connected with the data wireless transmission module; the data wireless transmission module is connected with the cloud server via network; a deep-learning network training module is established in the cloud server, face images are pre-trained, and feature vectors are saved; face images are extracted and transmitted to the cloud by virtue of the face detection module and the data wireless transmission module, and is input into the deep-learning network training module as a testing sample to match with faces, the match result is saved to a database, and the attendance information management webpage is interacted with the database to acquire attendance information. According to the system and method, matching identification is prevented from being performed in mass data by classified storage and classified calling, so that storage efficiency and matching identification efficiency can be improved, and the system has better robustness and higher efficiency.

The present invention discloses a distribution type of audience-choose-broadcasting video system and its data storing and accessing method. Said storing method includes the following steps: dividing a data file into data blocks in a predetermined manner; forming a data checking block for calculating the data blocks having predetermined number; storing the said data blocks and the data checking block into a plurality of predetermined buffer-server in turn in a predetermined manner; and creating corresponding index information for storing data blocks in each said buffer-server. The technical solution of the invention can improve storing efficiency and save a lot of storing space; and increase the safety of data because adopting the distribution type of memory and the data are distributed among a plurality of buffer-server.

Methods and apparatus are provided for classifying data packets in a data processing device according to a set of processing rules, wherein, for each of a predetermined group of data items in each packet, each rule defines a rule range indicating a range of possible values of the corresponding data item for which that rule applies. The method comprises for each data packet: (a) performing a preliminary test for at least one data item in said group, the preliminary test comprising testing the value of the data item in the packet for a match with any of a predetermined set of frequently-occurring values for that data item, each frequently-occurring value being associated with a predetermined indicator, and, if a match is obtained, selecting for the data item the indicator associated with the matching frequently-occurring value; (b) performing an item search for any data item in the group for which no match is obtained in a preliminary test, the item search for a said data item comprising selecting a range identifier corresponding to the value of the data item from a predetermined set of range identifiers for that data item, the set of range identifiers indicating, for all possible values of the data item, which of the rule ranges corresponding to the data item in the rule set a value intersects, wherein the indicator associated with a said frequently occurring value for a data item is the range identifier corresponding to that value of the data item; and (c) identifying, based on the selected range identifiers for all data items in the group, at least one rule of any rules applicable to the data packet.

The present application discloses a distributed storage system. The distributed storage system comprises an agent module, a metadata service module and a plurality of storage service modules, wherein each storage service module manages at least one storage node; and the metadata service module is used for maintaining a global first level mapping table, and the storage service module is used for maintaining a second level mapping table. As adoption of a two-level metadata organization, when data is written, if same data exists, actual writing is not carried out, thereby reducing the data writing operation and fulfilling the aim of deleting the global duplicated data. The present application further discloses a corresponding data read-write method. The application scheme can achieve the following technical effects: achieving an online global duplicate data delete in the distributed storage system, thereby reducing the actual storage space; and when writing the data, as the duplicate data does not need the actual writing operation, thereby saving the data communication and bandwidth of the application systems and the storage systems, and improving the storage efficiency.

The invention discloses a method for updating and storing a data file. The method comprises the following processing steps that: (1) a to-be-stored data file is divided into a plurality of data blocks, and a check code of each data block is respectively calculated and is attached to a fixed region of the data file; (2) the check code corresponding to each data block in an updated and stored new data file is respectively compared with the check code of a corresponding data block in an original data file; (3) the data blocks with different check codes are updated and stored, and the check codes of the data file are updated and stored. The method can reduce unnecessary data storage to increase storage efficiency and reduce data storage time, and be suitable to be used in the technical fields such as the data storage and the backup of communication equipment.

The present invention relates to a system and method for high-speed and bulk backup, and more particularly to a system and method for high-speed and bulk backup, wherein the data dispersed into a volume unit is set up, again divided into numerous units such as blocks to perform multi-processes that those units are compressed and transferred sequentially to different storage devices by a plurality of multiple threads, consequently, the time required for backup and recovery as well as the time required for data compression can be reduced as several flows are running simultaneously within a process, in a backup system for protecting the data stored on the storage unit to store the data within a system from disasters, defects, accidents, etc. According to the invention, since a bulk data can be transferred much faster, compared to conventional methods wherein a volume is compressed and transferred by a thread in charge, it has an effect that the time required for backup and recovery can be reduced substantially as well as the compression rate can be increased on a large scale.

The invention discloses a dynamically extensible and efficient single packet tracing method. The method comprises the following steps: in an inter-domain network composed of transit domains, constructing an anti-anonymous union by using all tracing Stub domains, wherein the anti-anonymous union configures ACL filtering rules on boundary routers of the tracing Stub domains, so that all anonymous packets entering the inter-domain network are cleared; constructing a tracing network in the tracing Stub domains, and establishing path fingerprint in the tracing network; and after the occurrence of attack, a network service provider directly locates an attack domain via the source address and an inlet router of the anonymous packet by using the anti-anonymous union, and then reduces an attack path through the extracted path fingerprint. By adoption of the dynamically extensible and efficient single packet tracing method disclosed by the invention, the coupling between autonomous domains is weakened so as to achieve the purpose of phased management and flexible control, and the leakage of the network topology privacy is avoided as well, which is beneficial to the expansion of the scale of the tracing system.