499results about "Multimedia data indexing" patented technology

A computer data processing system including a central processing unit configured with a novel integrated computer control software system for the management of data objects including dynamic and automatic organization, linking, finding, cross-referencing, viewing and retrieval of multiple objects regardless of nature or source. The inventive system provides underlying component architecture having an object-oriented database structure and a metadata database structure which is unique in storing only one instance of each object while linking the object to multiple collections and domains by unique metadata links for the grouping into and retrieval from any of the collections. The system employs configurable, extensible attribute/properties of data objects in metadata format, and a truly user-friendly configurable interface that facilitates faster, more unified, comprehensive, useful and meaningful information management. Additional features include a sticky path object hierarchy viewing system, key phrase linking, viewing by reference, and drag-and-drop relationship link creation.

The content metadata directory system connects consumers of identified content to managed metadata databases and other digital resources. The system manages links between identifiers in content objects and metadata sources. It supports a variety of different type of content identifiers and allows for overlap among different content identification schemes. One method of associating a content object with metadata uses a combination of a content identifier and a bounding identifier to enable handling of disparate sets of content identifiers for content objects with potentially conflicting content identifiers. The method receives a content identifier for a content object from among a set of content identifiers and provides a unique bounding identifier for the set of content identifiers. This unique bounding identifier is used in combination with the content identifier to form a globally unique identifier for the content object. This globally unique identifier is associated with a metadata source, which enables routing of a user to the metadata source.

The current disclosure uses the disciplines of Ontology and Epistemology to implement a context/content-based “multimedia conceptual search and planning”, in which the formation of conceptualization is supported by embedding multimedia sensation and perception into a hybrid database. The disclosed system comprises: 1) A hybrid database model to host concept setup. 2) A graphic user interface to let user freely issue searching request in text and graphic mode. 3) A parsing engine conducting the best match between user query and dictionaries, analyzing queried images, detecting and presenting shape and chroma, extracting features/texture of an object. (4) A translation engine built for search engine and inference engine in text and graphic mode. 5) A search engine using partitioned, parallel, hashed indexes from web crawler result, conducting search in formal/natural language in text and graphic mode. 6) A logic interference engine working in text and graphic mode, and 7) A learning/feedback interface.

A method and system for indexing, searching, and retrieving information from timed media files based upon relevance intervals. The method and system for indexing, searching, and retrieving this information is based upon relevance intervals so that a portion of a timed media file is returned, which is selected specifically to be relevant to the given information representations, thereby eliminating the need for a manual determination of the relevance and avoiding missing relevant portions. The timed media includes streaming audio, streaming video, timed HTML, animations such as vector-based graphics, slide shows, other timed media, and combinations thereof.

A digital work may be annotated using an eBook reader device. Upon receiving an annotation relating to a specific portion of the digital work, an invariant location reference identifier corresponding to the specified portion of the digital work may be appended to the annotation. The annotation may then be stored in association with the digital work for later reference. In some instances, an annotation may be presented on an eBook reader device upon receipt of a valid authorization credential granting access to the annotation.

A unique application within Video that allows for user generated Meta-tagging to be delivered in real time to individual clips is provided. This meta-tag creates its own tail based upon the user generated words population, which is searchable via a “spider network” that runs invisible behind the web pages of the site. These same “tagged” words are broadcast over various delivery networks including but not limited to live feeds from SMS, MMS, News Feeds within Community Web Sites, Video Sharing Web Sites, Widget applications any other forms of electronic communication that are dropped in real time to identified users and friends of users.

User interfaces for browsing and/or searching are described. In one embodiment, a method includes displaying a first display area for display representations of documents matching a search query, the first display area configured to display content of the documents which can have a plurality of different types of content including at least one of text-based content and a folder, and displaying a second display area for selecting a selected document to be displayed in the first display area. Other embodiments are also described, and computer readable media and apparatuses are also described.

A computerized method and apparatus is disclosed for merging content segments from a number of discrete media content (e.g., audio/video podcasts) in preparation for playback. The method and apparatus obtain metadata corresponding to a plurality of discrete media content. The metadata identifies the content segments and their corresponding timing information, such that the metadata of at least one of the plurality of discrete media content is derived using one or more media processing techniques. A number of the content segments are selected to be merged for playback using the timing information from the metadata. The merged media content can be implemented as a playlist identifying the content segments to be merged for playback. The merged media content can also be generated by extracting the content segments to be merged for playback from each of the media files/streams and then merging the extracted segments into one or more merged media files/streams.

A computer program embodied in a computer readable medium in a mobile station MS includes instructions to display a first identifier, such as a song title, associated with a first media (music or video) file and a second identifier identified with a second media file. The first identifier indicates that the first media file is stored in the MS and the second identifier indicates that the file is not stored within the MS. Five such identifiers are disclosed, with functionality to up/download the media files one or more at a time from a PC or a networked server. Playlists and albums may be similarly indicated in their identifiers. The user is enabled to create and edit playlists on the MS without regard to what media files are stored on the MS. The MS may store file identifiers for the database maintained on the PC, a large-scale database maintained at a media service server, or a portion thereof. A mobile station is also described.

A Mixed Media Reality (MMR) system and associated techniques are disclosed. The MMR system provides mechanisms for forming a mixed media document that includes media of at least two types (e.g., printed paper as a first medium and digital content and/or web link as a second medium). In one particular embodiment, the MMR system includes an action processor and method, and MMR documents with an associated action. The MMR document structure is particularly advantageous because the ability to specify different actions for different MMR documents, combined with the ability to create any number of MMR documents for a particular location on any media, allows the MMR architecture to serve as a universal trigger or initiator for additional processing. In other words, addition processing or actions can be triggered or initiated based on MMR recognition. The action processor receives the output of the MMR recognition process which yields an MMR document including at least one action. The action processor executes that action which includes various commands to the MMR system or other systems coupled to the MMR system. The MMR system architecture is advantageous because an action can be executed by pointing the capture device at a block of text, and the action is performed. Example actions include retrieving the text in electronic form to the capture device, retrieving the specification for the action, inserting data to a MMR document, transferring data between documents, purchasing items, authoring actions or reviewing historical information about actions. The MMR system includes a variety of user applications (one or more actions) initiated by the MMR recognition of a text patch such as information retrieval for a travel guide book, stock listings or advertisements; information capture such as recording content from a conference, recording and storing multimedia associated with the document, capturing information for a calendar and on the fly authoring; purchasing media files for storage on any part of an MMR document.

An approach provides distributed editing and storage of digital media. Video information is retrieved during recording of the video information to a video file. The video information is edited during the recording of the video information. An index file for the media is generated during the recording of the media, wherein the index file include indices for decoding the media; and periodically updating the index file throughout the recording of the media. After completion of the recording of the media, another index file is generated corresponding to the media for inclusion into the media file.

The overall architecture and details of a scalable video fingerprinting and identification system that is robust with respect to many classes of video distortions is described. In this system, a fingerprint for a piece of multimedia content is composed of a number of compact signatures, along with traversal hash signatures and associated metadata. Numerical descriptors are generated for features found in a multimedia clip, signatures are generated from these descriptors, and a reference signature database is constructed from these signatures. Query signatures are also generated for a query multimedia clip. These query signatures are searched against the reference database using a fast similarity search procedure, to produce a candidate list of matching signatures. This candidate list is further analyzed to find the most likely reference matches. Signature correlation is performed between the likely reference matches and the query clip to improve detection accuracy.

Methods and apparatus are described for matching a set input fingerprint blocks, each fingerprint block representing at least a part of an information signal, with fingerprints stored in a database that identify respective information signals. The method includes selecting a first fingerprint block of the set of input fingerprint blocks (10), and finding at least one fingerprint block in the database that matches the selected fingerprint block (20, 40). A further fingerprint block is then selected from the set of input blocks (60), at a predetermined position from the first selected fingerprint block. A corresponding fingerprint block is then located in the database at the same predetermined position relative to the found fingerprint block (70), and it is determined if the located fingerprint block matches the selected further fingerprint block (80).

A system and method for automatically and conveniently switching among paper, electronic and/or audio forms of a document or other data file by utilizing specialized versions and devices. Each version of the document has a plurality of identifying indicators representing specific locations. The accessing device automatically identifies the indicator associated with the last location accessed and transmits that indicator to other devices by a communication means. Those other devices then access the location in the alternative version corresponding to the location last accessed in the first version. The invention also allows for coordinated access to a document by multiple users on a number or variety of devices.

The present invention provides a unique method and user interface that facilitates accessing and browsing objects in which a user begins with a center object (e.g., one or a few focal objects) displayed on a screen and related objects are populated on the screen as well. The related objects can be further organized into clusters whereby each cluster or grouping of objects expands on a particular attribute of the center object. The attributes correspond to metadata. Thus, the objects are populated based upon the metadata of the center object. According to one aspect, the user can access one or more specific objects having a plurality of attributes and then relax at least one of the attributes to see what other objects share at least one attribute with the center object. According to another aspect, the object having the closest match to a search request can be centrally displayed with other close matches arranged by their respective metadata.

An efficient large scale search system for video and multi-media content using a distributed database and search, and tiered search servers is described. Selected content is stored at the distributed local database and tier1 search server(s). Content matching frequent queries, and frequent unidentified queries are cached at various levels in the search system. Content is classified using feature descriptors and geographical aspects, at feature level and in time segments. Queries not identified at clients and tier1 search server(s) are queried against tier2 or lower search server(s). Search servers use classification and geographical partitioning to reduce search cost. Methods for content tracking and local content searching are executed on clients. The client performs local search, monitoring and/or tracking of the query content with the reference content and local search with a database of reference fingerprints. This shifts the content search workload from central servers to the distributed monitoring clients.

A method and system authors multimedia documents from multimodal inputs. Also described are management, retrieval, and presentation of documents from the system.

A system and method of visually summarizing a hierarchically structured set of digital objects and for facilitating efficient access to such objects through the selection of representative summary objects. These digital objects are typically media objects such as digital image files, digital video clips, digital audio objects, such as “MP3” files, or other digital documents, such as text documents, that can be collected by a user and distributed over a variety of storage media and storage locations.

Communication is established between a first client and a central index server in a fluid, de-centralized network. The central index server searches the memory of the first client for usable data files which lack authentication certificates issued by the central index server. A data-file identifier is generated for a first data file among the select files lacking authentication certificates within the first client. The data-file identifier is compared to a reliable identifier in a main data base of the central index server. The reliable identifier is indexed within the main data base against a first unique reference ID. If the data-file identifier matches the reliable identifier, a valid authentication certificate is issued to the first data file in the first client. An IP address of the first client is then referenced against the first unique reference ID within the main data base of the central index server. When file request is received from a second client for a file represented by the first unique reference ID, a connection is facilitated between the first client and the second client so that the authenticated first multimedia data file can be transferred from the first client to the second client. If the data-file identifier does not match the reliable identifier within the data base, no authentication certificate is issued, and the first data-file identifier is systematically compared against a remaining plurality of identifiers within the main data base of the central index server to determine its true identity.

A computer-implemented method is provided, which includes receiving from a user a first search query consisting of one or more first query terms, and receiving from the user an indication of a desired level of personalization of refinement options for the search query. Responsively to the search query, a set of one or more refinement terms is generated at least in part responsively to the indication. The set of refinement terms is presented to the user. Responsively to a selection of at least one of the refinement terms by the user, the selected at least one refinement term is added to the first search query to generate a second search query. Search results are presented to the user responsively to the second search query. Other embodiments are also described.

A multimedia archive description scheme is provided for characterizing a multimedia archive having records and associated record descriptions. The multimedia archive description scheme provides a data structure which relates records by similarity measures. The principle data structure in the multimedia archive description scheme is a cluster. A cluster includes one or more attributes of the records in the archive and can include one or more cluster relationships. Cluster attributes can include feature space attributes, semantic attributes, media attributes and meta attributes of the records in the archive. The cluster relationships can relate records to clusters or clusters to clusters. Cluster relationships can include feature space (syntactic) relationships, semantic relationships, media relationships and meta relationships. The multimedia archive description scheme provides an efficient form for describing a collection of records.

A system for generating concept structures respective of a plurality of multimedia data elements (MMDEs). The system comprises an attention processor (AP) for generating a plurality of items from a received MMDE of the plurality of MMDEs and determining which of the generated items that are of interest for signature generation; a signature generator (SG) for generating at least a signature responsive to at least an item of interest of the received MMDE of the plurality of MMDEs; a clustering processor (CP) for clustering a plurality of signatures received from the signature generator responsive of the plurality of MMDEs, and for creating a signature reduced cluster (SRC) of the cluster; and a concept generator (CG) for associating metadata with the SRC and matches the SRC with previously generated SRC such that SRCs that match form a concept structure comprised of a plurality of SRCs and their associated metadata.

A method of managing multimedia content created using synchronous multimedia integration language (SMIL) and a file system thereof are provided. The method involves (a) extracting information on at least one resource file by parsing an SMIL document; and (b) packaging the SMIL document and the at least one resource file into a single file using the extracted information.

A robust fingerprinting system is disclosed. Such a system can recognize unknown multimedia content (U(t)) by extracting a fingerprint (a series of hash words) from said content, and searching a resembling fingerprint in a database in which fingerprints of a plurality of known contents (K(t)) are stored. In order to more efficiently store the fingerprints in the database and to speed up the search, the hash words (H(n)) of known signals (K(t)) are sub-sampled (13) by a factor M prior to storage in the database (14). The hash words (H(n)) of unknown signals (U(t)) are divided (16) into M interleaved sub-series (H0(n) . . . HM−1(n)). The interleaved sub-series are selectively (17) applied to the database (14) under the control of a computer (15). If only one of the sub-series sufficiently matches a stored fingerprint, the signal is identified.

A system and method for implementing a service oriented architecture that supports complex event processing and business activity monitoring. An enterprise service bus (ESB) generates a first list of one or more devices, receives a selection from a user associated with a first device of a second device in the first list, generates a second list that includes functions associated with the selection from the first user, receives a request from the first device to perform one of the functions in the second list, translates a first communication protocol of the request received from the first device into a second communication protocol used by the second device to create a translated request, translates a first message format of the request into a second message format and transmits the translated request to the second device.

Some aspects relate to systems and methods of tagging to enhance contextualization of media items and ease of use. Tag data structures provide an extensible platform to allow description of a concept from multiple points of view and in multiple contexts, such as locations, activities, and people. Individual application instances using these data structures can each maintain a private store of media items, and can be synchronized with a server. Each application owner can select portions of the private store to share. The server also can maintain canonical hierarchies of tags, such as hierarchies of activities and of places. These canonical hierarchies can be provided to application instances, where private modifications/additions can be made. Owners can offer to share private modifications, which can be accepted or rejected. Displays of media item selections and of clouds of related tags can be formed based on the contextual and relational information contained in the tags and in the canonical hierarchies.

A server system with one or more processors and memory maintains a database for a plurality of root media items, where: a respective root media item is associated with a family tree that includes a genesis node and multiple leaf nodes; and the genesis node corresponds to the respective root media item and a respective leaf node of the multiple leaf nodes corresponds to a first modified media item that is a modified version of the respective root media item. The server system: receives at least a portion of modified metadata corresponding to a second modified media item that is a modified version of a media item corresponding to a respective node in the family tree; and, in response, appends, to the family tree, a new leaf node that is linked to the respective node, where the new leaf node corresponds to the second modified media item.

Data storage operations, including content-indexing, containerized deduplication, and policy-driven storage, are performed within a cloud environment. The systems support a variety of clients and cloud storage sites that may connect to the system in a cloud environment that requires data transfer over wide area networks, such as the Internet, which may have appreciable latency and/or packet loss, using various network protocols, including HTTP and FTP. Methods are disclosed for content indexing data stored within a cloud environment to facilitate later searching, including collaborative searching. Methods are also disclosed for performing containerized deduplication to reduce the strain on a system namespace, effectuate cost savings, etc. Methods are disclosed for identifying suitable storage locations, including suitable cloud storage sites, for data files subject to a storage policy. Further, systems and methods for providing a cloud gateway and a scalable data object store within a cloud environment are disclosed, along with other features.

Systems and/or methods are provided that facilitate surveying media sources in a media entertainment system. An index component can provide an index of a set of available media sources in the media entertainment system. In addition, a selection component can displays the set of available media sources and receive selection requests for a subset of the available media sources. Further, a preview component can display a sample of media generated by the selected subset of media sources prior to active engagement thereof. Moreover, one or more aspects can be implemented in a vehicle entertainment system.

Systems and methods are provided for data mining in the context of an interactive video. During the presentation of an interactive video, a user may interact with the interactive video by, e.g., making selections, choosing options, etc. related to one or more aspects of the interactive video. Such events and details regarding the events may be recorded, stored, and analyzed in the context of one or more campaigns associated with the interactive video, such as marketing campaigns, advertising campaigns, interactive examinations, etc. Once the details regarding the events have been stored, reports may be extracted based upon the details detailing any desired information relevant to the one or more campaigns.