3208results about How to "Efficient storage" patented technology

The invention provides a method and system for creating an innovative file system that separates its directory presentation from its data store. The method and system include processing, division, distribution, managing, synchronizing, and reassembling of file system objects that does not delay the presentation of the content to the user, but also uses a reduced amount of storage space. The invention includes the ability to manage and control the integrity of the files distributed across the network, and the ability to serve and reconstruct files in real time using a Virtual File Control System.

A computer data processing system including a central processing unit configured with a novel integrated computer control software system for the management of data objects including dynamic and automatic organization, linking, finding, cross-referencing, viewing and retrieval of multiple objects regardless of nature or source. The inventive system provides underlying component architecture having an object-oriented database structure and a metadata database structure which is unique in storing only one instance of each object while linking the object to multiple collections and domains by unique metadata links for the grouping into and retrieval from any of the collections. The system employs configurable, extensible attribute/properties of data objects in metadata format, and a truly user-friendly configurable interface that facilitates faster, more unified, comprehensive, useful and meaningful information management. Additional features include a sticky path object hierarchy viewing system, key phrase linking, viewing by reference, and drag-and-drop relationship link creation.

A method and system is disclosed for providing a cloud storage system supporting existing APIs and protocols. The method of storing cloud storage system (CSS) object metadata separates object metadata that describes each CSS object as a collection of named chunks with chunk locations specified as a separate part of the metadata. Chunks are identified using globally unique permanent identifiers that are never re-used to identify different chunk payload. While avoiding the bottleneck of a single metadata server, the disclosed system provides ordering guarantees to clients such as guaranteeing access to the most recent version of an object. The disclosed system also provides end-to-end data integrity protection, inline data deduplication, configurable replication, hierarchical storage management and location-aware optimization of chunk storage.

Grouping and navigating media files within a playlist on a computer-readable medium. Invention software selects media files according to a grouping criterion to define a group from the media files. The invention software generates a group header associated with the group. The group header includes a value identifying the defined group and a reference to another group to enable navigation. The invention software stores the selected media files, the playlist, the defined groups, and the associated group headers on a computer-readable medium. The invention software also includes playback software for navigating and selecting media files via groups within a playlist. In one embodiment, the invention is operable as part of a compressed media format having a set of small files containing metadata, menus, and playlists in a compiled binary formal designed for playback on feature-rich personal computer media players as well as low cost media players.

A system for gathering, formatting, validating, compressing, processing and storing a large volume of transactional data is presented. The system preferably analyzes pharmaceutical drug transactions. Importantly, the method of compressing the gathered data of the present invention detects repetitive behavior, and data patterns, to more efficiently process and store the large volume of transactional data. Also, the stored data is processed and analyzed more quickly due to its reduced size. Further, the present invention retains all useful information represented by the transactional data after compression of the data (i.e., it does not filter data for the purpose of reducing the quantity of data). The results of the process give users a truer sense of market activity. Additionally, the present invention allows new data to be added to historical data to allow a progressive analysis of the data.

Methods, systems, apparatus including computer programming encoded on a computer storage medium for efficiently storing data across memory hierarchy on one or plurality of nodes include creating ordered partitions of data based on key where partition order is achieved using highly space optimized prefix tree index. Within a partition, data is fully or partially ordered based on key. Multiple prefix tree indices are created one for each memory hierarchy and all are stored in fast memory like DRAM. Data is merged or moved from faster memory to slower memory in the hierarchy as the space is used up. Checkpoint mechanism along with WAL provides recovery guarantee and data snapshots. Distributed data storage systems like databases/key value stores can utilize this data storage mechanism to store and retrieve data efficiently across memory hierarchy on one or plurality of nodes.

A “forward” delta data management technique uses a “sparse” index associated with a delta file to achieve both delta management efficiency and to eliminate read latency while accessing history data. The invention may be implemented advantageously in a data management system that provides real-time data services to data sources associated with a set of application host servers. To facilitate a given data service, a host driver embedded in an application server connects an application and its data to a cluster. The host driver captures real-time data transactions, preferably in the form of an event journal that is provided to the data management system. In particular, the driver functions to translate traditional file/database/block I/O into a continuous, application-aware, output data stream. In an illustrative embodiment, a given application aware data stream is processed through a multi-stage data reduction process to produce a compact data representation from which an “any point-in-time” reconstruction of the original data can be made.

A method, computer program product, and data processing system for efficiently storing a set of hierarchically-specified names in a modular hardware design are disclosed. In accordance with a preferred embodiment of the present invention, a data structure for storing the names is built from a master trie. The master trie is used to store names of instances of modules contained within the design. The node in the master trie corresponding to a particular instance name is associated with an additional trie (“class trie”) corresponding to the class of module to which that instance belongs. In this additional trie are stored the names of the individual signals associated with that class of module. Where there are multiple instances of the same class of module within a design, each instance name may be associated with a single class trie storing each of the individual signal names associated with that class of module.

A memory system that is compatible with hosts using different protocols includes protocol adapters for the different protocols. Protocol adapters allow a common backend system to be used for data that is provided in different formats. A protocol adapter generates responses to a host and generates commands for a backend as appropriate.

A system for fully integrated collection of business impacting data, analysis of that data and generation of both analysis-driven business decisions and analysis driven simulations of alternate candidate business actions has been devised and reduced to practice. This business operating system may be used predict the outcome of enacting candidate business decisions based upon past and current business data retrieved from both within the corporation and from a plurality of external sources pre-programmed into the system. Both single parameter set and multiple parameter set analyses are supported. Risk to value estimates of candidate decisions are also calculated.

Apparatus and methods provide relatively low uncorrectable bit error rates, low write amplification, long life, fast and efficient retrieval, and efficient storage density such that a solid-state drive (SSD) can be implemented using relatively inexpensive MLC Flash for an enterprise storage application. A page is associated with a set of primary ECC codewords, and a page stripe is associated with a set of secondary codewords and primary over secondary parity (PoSP) ECC codewords. Two or more page stripes can form a page grid, wherein the page grid is associated with a group of tertiary ECC codewords, wherein the last page stripe of the page grid has a reduced payload capacity.

A method of managing file permissions in a remote file storage system includes defining permissions for the remote file storage system and controlling access to objects on the remote file storage system according to the permissions of the remote file storage system. The permissions are transferred to a client file storage system remote from the remote file storage system, and access to objects on the client file storage system is controlled according to the permissions of the remote file storage system. A remote file storage system includes a permissions file generator operative to generate a permissions file, which is transmitted to a client file storage system for enforcement at the client file storage system.

Files that are mapped to a logical address range by a host become logically fragmented prior to being sent to a memory system. Subsequently, the logically fragmented portions are reassembled when they are stored in blocks in the memory system. The host supplies information to the memory system regarding file-to-logical mapping of data prior to sending the data. The memory selects storage locations for the data based on the files to which the data belong.

In a presently preferred embodiment of the invention, a three-dimensional scene is reproduced on a specialized light display which offers full multiviewpoint capability and auto-stereoscopic views. The displayed image is produced using a set of M two-dimensional images of the scene collected at a set of distinct spatial locations. These M two-dimensional images are processed through a specialized mathematical encoding scheme to obtain a set of NxK display-excitation electrical-input signals, where K is the number of pixels in the display, and N<=M is the number of individual light-radiating elements within one pixel. The display is thus comprised of a total of NxK light-radiating elements. Each of the K pixels is adapted for control of their associated radiance patterns. The display is connected for response to the set of NxK display-excitation electrical-input signals. In this manner, the display provides a multiviewpoint and autostereoscopic three-dimensional image associated with the original three-dimensional scene. An alternative embodiment of the invention is utilized to provide efficient storage and display of 3D computer graphics images.

Distortion modeling produces distortion models for use by a distortion synthesizer to synthesize the harmonic distortion effects of audio distortion devices. A sinusoidal waveform is distorted by an audio distortion device and analyzed using a Fourier transform to produce a distortion model comprising harmonic amplitude and phase parameters. A phase correction process compensates for phase shifts induced by the audio distortion device. The distortion synthesizer uses a distortion function that distorts a digital audio signal according to the distortion model. The distortion model can be modified to alter the distortion effect and can be stored in a data-storage device for later retrieval. A frequency bandsplitter and signal mixer allow the distortion effect to be applied only to the low frequency content of the digital audio signal, thus providing spectral headroom to suppress the production of aliasing noise. Aliasing-noise suppression is provided for a full-bandwidth signal by up-converting the sampling rate of the signal before applying the distortion function and down-converting the sampling rate afterwards. A process is provided to remove the direct-current component that may be induced into the signal by the distortion function.

A memory system that is compatible with hosts using different protocols includes protocol adapters for the different protocols. Protocol adapters allow a common backend system to be used for data that is provided in different formats. A protocol adapter generates responses to a host and generates commands for a backend as appropriate.