1757 results about "Indexed file" patented technology

A system and method for “on-the-fly” de-duplication of data before storing the data in a storage system is provided. A data de-duplication module illustratively cooperates with protocol servers and a file system of a storage operating system executing on the storage system to implement the novel de-duplication technique. The de-duplication module illustratively generates a block store, an index file and a hash table on storage space provided by the storage system. The hash table is utilized for tracking fingerprints and locations of blocks within the block store. The index file is utilized for storing directory information identifying the contents of data containers stored on the storage system, while the block store is utilized to store raw data blocks that comprise the data containers.

A computer filing system includes a data access and allocation mechanism including a directory and a plurality of indexed data files or hash tables. The directory is preferably a radix tree including directory entries which contain pointers to respective ones of the hash tables. Using a plurality of hash tables avoids the whole database ever having to be re-hashed all at once. If a hash table exceeds a preset maximum size as data is added, it is replaced by two hash tables and the directory is updated to include two separate directory entries each containing a pointer to one of the new hash tables. The directory is locally extensible such that new levels are added to the directory only where necessary to distinguish between the hash tables. Local extensibility prevents unnecessary expansion of the size of the directory while also allowing the size of the hash tables to be controlled. This allows optimisation of the data access mechanism such that an optimal combination of directory-look-up and hashing processes is used. Additionally, if the number of keys mapped to an indexed data file is less than a threshold number (corresponding to the number of entries which can be held in a reasonable index), the index for the data file is built with a one-to-one relationship between keys and index entries such that each index entry identifies a data block holding data for only one key. This avoids the overhead of the collision detection of hashing when it ceases to be useful.

Content directed towards a user is identified and the classification of the content is determined and used in the creation of a personalized RSS feed that gives a user controlled access to the data. Multiple classes of RSS feeds are generated based on the contents and as such, a user can have one RSS feed that is password protected and one that is readily available. By varying the access controls on the RSS based files, multiple classes of RSS feeds can be created. Additionally, a single RSS feed may be applied for carrying multiple classes of content. The underlying content is stored in XML content files that have an access control mechanism applied to them. Thus, upon actuating a link in an RSS XML index file, the user may be required to enter access credentials.

A method for video playback switching in response to changing network conditions. The method includes accessing a server to retrieve respective index files for a low bit rate version and a high bit rate version of the video file, and instantiating a low bit rate media player and a high bit rate media. Playback of the video file is begun by the high bit rate media player streaming the high bit rate version from the server. Upon an indication of impeded network conditions, a transition point is selected, wherein the transition point indicates where downloading of the high bit rate version stops and where downloading of the low bit rate version begins. The low bit rate media player is then positioned to begin playback at the transition point. Playback of the video file is then switched to the low bit rate player upon encountering the transition point.

An approach provides distributed editing and storage of digital media. Video information is retrieved during recording of the video information to a video file. The video information is edited during the recording of the video information. An index file for the media is generated during the recording of the media, wherein the index file include indices for decoding the media; and periodically updating the index file throughout the recording of the media. After completion of the recording of the media, another index file is generated corresponding to the media for inclusion into the media file.

An improved method and apparatus for creating a snapshot of a file system. A record of which blocks are being used by a snapshot is included in the snapshot itself, allowing effectively instantaneous snapshot creation and deletion. The state of the active file system is described by a set of metafiles; in particular, a bitmap (henceforth the “active map”) describes which blocks are free and which are in use. The inode file describes which blocks are used by each file, including the metafiles. The inode file itself is described by a special root inode, also known as the “fsinfo block”. The system begins creating a new snapshot by making a copy of the root inode. This copy of the root inode becomes the root of the snapshot.

Advertisements over a network, such as the Internet, by extracting an index file of suppliers of search result sets for a plurality of keywords and/or an index of ads to be placed. A keyword in a received query may be matched to the suppliers of related search result sets and/or the ads to be placed in the index file(s). The search results may be ranked based on various criteria such as yield, click through rates and history of dealings. Search result sets for the keywords from the matching suppliers and the ads to be placed may be combined to produce a search result set ranked in accordance with estimated yields for advertisements associated with each result in the search result set and delivered in response to the received query. The search results in the combined set may be reranked and/or repriced.

Disclosed is a method and system for selectively restoring file-level data from a disk image backup. In embodiments, a virtual machine backup may be performed by dividing a virtual machine virtual disk file into a plurality of discrete fixed-sized data blocks sharing a common index file that is stored on a backup medium, such as a hard drive, to form a backup set. Upon restoration of data from the backup set, individual blocks of the data set are compared to corresponding blocks of the target virtual machine file. Redundant data and unchanged blocks are skipped, and only those block which have changed are restored to the target file. In this manner network bandwidth and processor resources are conserved, and replication times decreased.

Provided are a method, system, and program for processing a request to write to a source file in a storage system. A determination is made as to whether a retention rule is provided for the source file. In response to determining that one retention rule is provided for the source file, a versioned file name is generated, wherein a versioned file comprises the source file at a point-in-time. A command is transmitted to a file system to copy the source file data to a versioned file having the generated versioned file name and the generated versioned file name is added to a retention index file. The retention index file is processed to determine whether to purge versioned files according to the retention rule provided for the source file.

A system for delivering advertisements via the internet may include an index file having entries related to advertisements for delivery via the internet, an extraction engine for updating the index file entries in accordance with changes in a database of said advertisements, a matching engine for matching a keyword in a query string to a plurality of the index file entries, a ranking engine for selecting an advertisement, for inclusion in a search result set responsive to the query sting, in accordance with an estimated monetary yield related to one of the plurality of index file entries matching a keyword in the query string and a pricing engine for discounting a charge for that inclusion in accordance with an estimated monetary yield for another one of the plurality of index file entries.

Events in a first data stream are correlated with events in a second data stream based on a method of indexing. As information of a first and second data stream are stored to a data file, the data streams are monitored for certain trigger events. An informational data set is generated and stored in an index file for each detected trigger event. Preferably, each informational data set includes the type of detected event, a time-stamp indicating when the event occurred and a data pointer indicating where the data associated with the event is stored in a corresponding data file. When time-stamps of detected trigger events in both data streams are generated based on a common system clock, data in one data stream is correlated with data in another data stream based on the time-stamps.

Systems and methods for image pattern recognition comprise digital image capture and encoding using vector quantization (“VQ”) of the image. A vocabulary of vectors is built by segmenting images into kernels and creating vectors corresponding to each kernel. Images are encoded by creating a vector index file having indices that point to the vectors stored in the vocabulary. The vector index file can be used to reconstruct an image by looking up vectors stored in the vocabulary. Pattern recognition of candidate regions of images can be accomplished by correlating image vectors to a pre-trained vocabulary of vector sets comprising vectors that correlate with particular image characteristics. In virtual microscopy, the systems and methods are suitable for rare-event finding, such as detection of micrometastasis clusters, tissue identification, such as locating regions of analysis for immunohistochemical assays, and rapid screening of tissue samples, such as histology sections arranged as tissue microarrays (TMAs).

Systems and methods are described for storing a media stream on a storage medium, wherein the media stream is based upon at least one source file. An index file for the media stream is created, and the at least one source file is processed to create at least one media file that is stored on the storage medium. The index file is updated to reference at least a portion of the at least one media file, and the index file is stored on the storage medium. Such techniques may be useful, for example, in encoding information onto a disk drive, flash drive or other portable media compatible with a placeshifting audio/video player or the like.

Embodiments of the present invention comprise methods and systems for communicating a recipient-selected customization of a digital image using an index file. The index file associates a customization characteristic with the segments of the digital image required to construct a customized image that exhibits the customization characteristic.

Disclosed is a method and system for selectively restoring file-level data from a disk image backup. In embodiments, a virtual machine backup may be performed by dividing a virtual machine virtual disk file into a plurality of discrete fixed-sized data blocks sharing a common index file that is stored on a backup medium, such as a hard drive, to form a backup set. The index file is referenced to determine which fixed-sized block contains volume information, such as a partition table, of the backed-up virtual machine file. The individual blocks are processed as a virtual filesystem which is presented to an access module, which traverses the filesystem and provide access to individual files in the image backup to a client process, the restore files may be delivered to the client in a container file, which may be compressed to increase transfer speed. The container file may include executable instructions for automatically restoring the files to a desired location.

The invention relates to a system to provide local mobile geographic information service based on GPS and mobile terminal. The system comprises: a wireless communication network, a GPS position apparatus and mobile terminal, and an internet and path tracking server. The innovation of the invention is adding the following software functional modules in the mobile terminal: a wireless communication module, a GPS receiving module, an interface displaying module, an interest point inquiring module, a path planning module, a positioning module, a path tracking module, a GIS engine module, a database management module and a data layer made up of an interest point database, a geographic data file, a geographic data index file, a geographic data topological file and a initialization configuration file. The system achieves the advantages of simple, practical, smart in data layer design, convenient in inquiring, low in cost and easy to implement. For storing geographic space data and integrating many software functional modules in the mobile terminal, the system in the invention enable the user to enjoy localized real time geographic space position service conveniently at any moment with less dependence on the server.

The invention provides an expression search engine which comprises a communication module and an expression index module, wherein the communication module is used for receiving expression labeling information containing expression pictures and corresponding labeling texts; and the expression index module is used for generating an expression index file according to the expression labeling information. Compared with the prior art, the invention has the advantages that the expression search engine and an expression management system are used for acquiring the labeling information of expressions and establishing an index, so that sets of relevant expressions can be quickly researched through the labeling information of the expressions while an expression research service is provided, and a research result list can be returned, thereby the quantity of recalled effective results and the researching accuracy are improved, and the qualities of returned expressions are improved; and in addition, the expression picture sets can be sequenced through relevant coefficients, thus a user can quickly find out interested pictures from the research result list, and thereby the using convenience of the user is improved, and the network flow is saved.

A system and method for selectively indexing file system content. In one embodiment, the system may include a storage device configured to store data and a file system configured to manage access to the storage device and to store file system content, where the file system content may include a file associated with a pathname. The system may further include a search engine configured to construct an index of the file system content, where constructing the index includes generating index information associated with the file. In response to the file being moved or renamed, the search engine may be further configured to preserve existing index information associated with the file without regenerating the existing index information.

A system and method indexes an image database by partitioning an image thereof into a plurality of cells, combining the cells into intervals and then spots according to perceptual criteria, and generating a set of spot descriptors that characterize the perceptual features of the spots, such as their shape, color and relative position within the image. The shape preferably is a derivative of the coefficients of a Discrete Fourier Transform (DFT) of the perimeter trace of the spot. The set of spot descriptors forms as an index entry for the spot. This process repeated for the various images of the database. To search the index, a key comprising a set of spot descriptors for a query image is generated and compared according to a perceptual similarity metric to the entries of the index. The metric determines the perceptual similarity that the features of the query image match those of the indexed image. The search results are presented as a scored list of the indexed images. A wide variety of image types can be indexed and searched, including: bi-tonal, gray-scale, color, "real scene" originated, and artificially generated images. Continuous-tone "real scene" images such as digitized still pictures and video frames are of primary interest. There are stand alone and networked embodiments. A hybrid embodiment generates keys locally and performs image and index storage and perceptual comparison on a network or web server.

A method for fast and efficient record retrieval in large databases using cyclical redundancy check (CRC) computations as hash functions. Two hash values are computed for each record's key using the CRC-CCITT and CRC-16 generator polynomials. The two CRC values then are combined into a four-byte composite hash value that represents a binary signature of the record's key. Alternately, a single CRC-32 value can be used as a four-byte hash value. In most cases, this four-byte hash value uniquely identifies the record's key. An index file is constructed using a hybrid search method, part hash table and part linear search. The index file is searched to find a match for the four-byte hash value and the record's offset is obtained. The record's offset is used to retrieve the record from the database.

A group of documents in a forum/message board are stored as a document group database in a predetermined server computer. A document group analysis device analyzes a group of documents contained in each set of documents corresponding to each message board in the document group database. A summation device generates a meta-index, a thread index, and an indexed file. A display device displays a group of documents in a display format of a keyword view, a thread view, or an author view using a meta-index and a thread index.

The invention discloses methods for establishing and inquiring index of a distributed column storage database, a device and a system thereof. The method for establishing index of a distributed column storage database comprises the steps of obtaining the column fields in the distributed column storage database to generate a column index file with the column fields as keywords, wherein the column index file contains the mapping relation between the values of the column fields in the distributed column storage database and the values of the corresponding Row fields; storing the column index file into the index directory corresponding to the column fields in the distributed column storage database. The method for inquiring index is implemented by matching corresponding index files to obtain corresponding values of Row fields when a client launches an inquiry request with the column fields as inquiry condition and result. By adopting the invention, fast inquiry of other column fields except for the Row fields can be realized in the prior distributed column storage database.

Metadata files representing Web document content are parsed in accordance with a specification file, with a specification file being generated for each class of documents, e.g., HTML pages, newsgroup articles, and JAVA programs. Each specification file has the same format, i.e., schema, as a metadata file for the associated document class. Within each specification file, each element in the hierarchy is associated with a weight. When a metadata file is received, both the metadata file and the specification file are walked through top-down to parse data out of the metadata file into an index file in accordance with the weights in the specification file, e.g., a data element having a weight of zero is not written to the index file, an element with a weight of two is written out twice to the index file, and so on. Importantly, the tags in the metadata file are not written out to the index file. The index file is then used by an index engine to build an index, which can then be accessed by a query executor to respond to a user query for Web documents without having to search through an index containing tags and other data that is irrelevant to the search.

The invention provides a data block comparison based data updating method. The method comprises the following steps: (1) respectively dividing data in all versions into a plurality of data blocks, respectively extracting all documents in the data in each version and labeling map information of each data block against the data in each version; (2) establishing a corresponding index document against the data in each version; and (3) figuring out data blocks in the data in the previous version different from that in the data in the next version according to the attribute information of all documents and labeling map information in the index document in the next version when data are updated, and updating the data blocks. The data updating method greatly improves the speed of data updating by data division and specific updating algorithm, and further reduces load of a server by combining with an improved network download structure, and improves the performance of network transmission.