1423results about "Video data indexing" patented technology

A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.

Fast metadata indexing and delivery for broadcast audio-visual (AV) programs by using template, segment-mark and bookmark on the visual spatio-temporal pattern of an AV program during indexing. The broadcasting time carried on a broadcast transport stream is used as a locator allowing direct access to a specific temporal position of a recorded AV program.

An apparatus for multi-bitrate content streaming includes a receiving module configured to capture media content, a streamlet module configured to segment the media content and generate a plurality of streamlets, and an encoding module configured to generate a set of streamlets. The system includes the apparatus, wherein the set of streamlets comprises a plurality of streamlets having identical time indices and durations, and each streamlet of the set of streamlets having a unique bitrate, and wherein the encoding module comprises a master module configured to assign an encoding job to one of a plurality of host computing modules in response to an encoding job completion bid. A method includes receiving media content, segmenting the media content and generating a plurality of streamlets, and generating a set of streamlets.

A method and system are provided for tagging, indexing, searching, retrieving, manipulating, and editing video images on a wide area network such as the Internet. A first set of methods is provided for enabling users to add bookmarks to multimedia files, such as movies, and audio files, such as music. The multimedia bookmark facilitates the searching of portions or segments of multimedia files, particularly when used in conjunction with a search engine. Additional methods are provided that reformat a video image for use on a variety of devices that have a wide range of resolutions by selecting some material (in the case of smaller resolutions) or more material (in the case of larger resolutions) from the same multimedia file. Still more methods are provided for interrogating images that contain textual information (in graphical form) so that the text may be copied to a tag or bookmark that can itself be indexed and searched to facilitate later retrieval via a search engine.

A media content playlist generation and access system for a video entertainment network is herein disclosed whereby a plurality of media content emanating from various disparate networks may be conglomerated into a customized list. The list may contain stored media content, which are customarily stored in the head end portion of a CATV network, media content accessible via the Internet, or yet to be aired media content. The system also provides for manipulation of the playlist from various consumer electronic display devices that are interconnected to the Internet, or the PSTN, thereby allowing further customization of the playlist at the user's convenience. Additionally, a multiple user account system is provided wherein multiple user accounts may be configured in order to allow a corresponding multiple individualized playlists, which are each customized to suit each user's tastes.

A method and system are provided for tagging, indexing, searching, retrieving, manipulating, and editing video images on a wide area network such as the Internet. A first set of methods is provided for enabling users to add bookmarks to multimedia files, such as movies, and audio files, such as music. The multimedia bookmark facilitates the searching of portions or segments of multimedia files, particularly when used in conjunction with a search engine. Additional methods are provided that reformat a video image for use on a variety of devices that have a wide range of resolutions by selecting some material (in the case of smaller resolutions) or more material (in the case of larger resolutions) from the same multimedia file. Still more methods are provided for interrogating images that contain textual information (in graphical form) so that the text may be copied to a tag or bookmark that can itself be indexed and searched to facilitate later retrieval via a search engine.

A multi-dimensional database and indexes and operations on the multi-dimensional database are described which include video search applications or other similar sequence or structure searches. Traversal indexes utilize highly discriminative information about images and video sequences or about object shapes. Global and local signatures around keypoints are used for compact and robust retrieval and discriminative information content of images or video sequences of interest. For other objects or structures relevant signature of pattern or structure are used for traversal indexes. Traversal indexes are stored in leaf nodes along with distance measures and occurrence of similar images in the database. During a sequence query, correlation scores are calculated for single frame, for frame sequence, and video clips, or for other objects or structures.

An apparatus for content item signature matching comprises a database (103) which has signatures for a plurality of content items. A likelihood processor (105) determines a match likelihood indication for the content items where the match likelihood indication is indicative of a likelihood of a match between the content item and an unknown signature. An interface (111) receives a query signature associated with a content item and in response a search processor (113) searches the database (103) for a matching signature to the query signature. The search processor (113) is operable to search the database in response to the match likelihood indication of the plurality of content items. In particular the database (103) may be ordered in order of decreasing probability of a match and the search processor (113) may search the database in this order. Hence, the probability of an early match is increased and the average search time is reduced.

The present invention relates to a system for generating a description record from multimedia information including, e.g., video data. A multimedia information input interface is used to receive multimedia information. A computer processor receives the multimedia information, processes the video information by performing video object extraction processing to generate video object descriptions from the video information, processes the generated video object descriptions by object hierarchy construction and extraction processing to generate video object hierarchy descriptions, and processes the generated video object descriptions by entity relation graph descriptions.

A method and system for description of synthetic audiovisual content makes it easier for humans, software components or devices to identify, manage, categorize, search, browse and retrieve such content. For instance, a user may wish to search for specific synthetic audiovisual objects in digital libraries, Internet web sites or broadcast media; such a search is enabled by the invention. Key characteristics of synthetic audiovisual content itself such as the underlying 2d or 3d models and parameters for animation of these models are used to describe it. More precisely, to represent features of synthetic audiovisual content, depending on the description scheme to be used, a number of descriptors are selected and assigned values. The description scheme instantiated with descriptor values is used to generate the description, which is then stored for actual use during query / search. Typically, a user, to search for a needed synthetic audiovisual content initiates a query that is passed on to a search engine that then retrieves the candidate content from one or more databases whose description closely matches the query criteria specified by the user.

A method and apparatus for extracting a model vector representation from multimedia documents. A model vector provides a multidimensional representation of the confidence with which multimedia documents belong to a set of categories or with which a set of semantic concepts relate to the documents. A model vector can be associated with multimedia documents to provide an index of its content or categorization and can be used for comparing, searching, classifying, or clustering multimedia documents. A model vector can be used for purposes of information discovery, personalizing multimedia content, and querying a multimedia information repository.

Disclosed are systems and methods for reducing video communication bandwidth requirements of a video surveillance network camera system that includes network communication paths between network video cameras producing video streams of scenes observed by the network video cameras and content-aware computer networking devices analyzing by video analytics video visual content of the video streams to provide managed video representing, at specified quality levels, samples of the scenes observed. Distribution of the managed video consumes substantially less network bandwidth than would be consumed by delivery through network communication paths a video stream at the specified quality level in the absence of analysis by the video analytics.

A method and apparatus for deriving performance statistics from real time tracking of a sporting event. The method according to the present invention includes a step of obtaining a spatio-temporal trajectory corresponding to the motion of an athlete and based on real time tracking of the athlete. The trajectory is then broken down so that performance information corresponding to the motion of the athlete (such as speed, distance covered, acceleration, etc.) can be derived with respect to time. The information so obtained can be stored in a database or the like for later retrieval or can be used to graphically supplement a video broadcast of a sporting event. The apparatus includes a device for obtaining the trajectory, a computational device for obtaining the performance information based on the obtained trajectory, and a statistical device for compiling the performance information. In particular, the spatio-temporal trajectory may be obtained by an operation on a video image of the sporting event, in which motion regions in the image are identified, and feature points on the regions are tracked as they move, thereby defining feature paths. The feature paths, in turn, are associated in clusters, which clusters generally correspond to the motion of some portion of the athlete (e.g., arms, legs, etc.). The collective plurality of clusters corresponds with the motion of the athlete as a whole.

Disclosed is a system for viewing video having segmented video objects, sharing selected ones of the video objects, and purchasing products associated with the video objects. The system includes a video server communicating with a consumer server over a distributed network. The video server includes at least one video file, an object inventory database, and relevant content in a database stored on or accessible to the video server. The object inventory database contains information describing a location of at least one video object within the at least one video file. A video overlay links the relevant content with a given video object and creating a selectable hyperlink whose position tracks a dynamic location of the video object in the video. The consumer server includes a software application for accessing and displaying the at least one video file stored in the video database, the software application including means for interacting with the video overlay to select an object displayed in the video file.

A video data recordable having integrated channel guides allowing a user to control recording and storage of television signals into personal channels for later playback and viewing. In the described embodiment, the user may specify criteria for recording of shows from an input source such as a broadcast signal and shows are then selected based on the user specified criteria and recorded for later playback. Storage of the shows may be organized into personal channels in order to facilitate later playback, e.g., the user may specify a channel of action movies, a channel of nature programming, a channel for sports, etc. The shows to be recorded may also have a predefined format which may be used to ease playback of recorded programming by allowing the user to easily locate and playback sections of programming of interest.

A method and apparatus for indexing digital video and audio signals using a digital database. A user may index the digital images by content within the images, through annotation, and the like. The database can contain high resolution and low resolution versions of the audio-video content. The indexed video can be used to create web pages that enable a viewer to access the video clips. The indexed video may also be used to author digital video disks (DVDs). The video may be enhanced to achieve DVD quality or be accessed to enhancing the digital signals and indexing the digital signals. The user may choose to enhance the digital signals by combining frames into a panorama, enhancing the resolution of the frames, filtering the images, and the like.

A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video / audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.

A method and apparatus for forming a visual index of scenes in a video image which has been or is being recorded in a computer readable memory. A selected number of keyframes are derived from the recorded image, each being representative of a respective scene therein. The keyframes are then ordered into a selected number of levels of detail of the scenes represented thereby, each level including a predetermined number of keyframes, each subsequent level including keyframes of greater detail than those in a preceding level. A header file is then formed which is descriptive of the ordered set of keyframes, and the header file is stored together with the ordered set of keyframes in the computer readable memory. A user can thereby identify and obtain optimized retrieval in accordance with his preferences of particular segments of the video image from a relatively slow memory device. The method and apparatus are equally applicable to formation of an indexed order of binary large objects ("blobs") in a set of multimedia documents in accordance with a user's preferences.

The information delivery system is configured with a media database 1009 which stores media data, a sequence information database 1008 which stores sequence information for specifying the address of media data to deliver, a scene searcher 1005 which verifies the sequence information according to a request of the controlling media received from client terminal 1000 and retrieves appropriate media data from the media database 1009 starting from a prescribed point based on a result of the verification, and an output unit 1006 which delivers the retrieved media data to the client terminal 1000.

Multimedia content containing moving pictures and audio is divided into multiple scenes and metadata is generated for each of the scenes obtained as a result of the division. It is possible to generate metadata containing scene structure information metadata that describes the hierarchical structure of the content in addition to scene section information and titles. Also, a name or an identifier of each descriptor contained in the metadata is described as hint information for manipulation of metadata composed of at least one descriptor describing semantic content, a structure, and characteristics of content.

An intelligent video / audio observation and identification database system may define a security zone or group of zones. The system may identify vehicles and individuals entering or exiting the zone through image recognition of the vehicle or individual as compared to prerecorded information stored in a database. The system may alert security personnel as to warrants or other information discovered pertaining to the recognized vehicle or individual resulting from a database search. The system may compare images of a suspect vehicle, such as an undercarriage image, to standard vehicle images stored in the database and alert security personnel as to potential vehicle overloading or foreign objects detected, such as potential bombs. The system may further learn the standard times and locations of vehicles or individuals tracked by the system and alert security personnel upon deviation from standard activity.

An invention for generating standard description records from multimedia information. The invention utilizes fundamental entity-relation models for the Generic AV DS that classify the entities, the entity attributes, and the relationships in relevant types to describe visual data. It also involves classification of entity attributes into syntactic and semantic attributes. Syntactic attributes can be categorized into different levels: type / technique, global distribution, local structure, and global composition. Semantic attributes can be likewise discretely categorized: generic object, generic scene, specific object, specific scene, abstract object, and abstract scene. The invention further classifies entity relationships into syntactic / semantic categories. Syntactic relationship categories include spatial, temporal, and visual categories. Semantic relationship categories include lexical and predicative categories. Spatial and temporal relationships can be topological or directional; visual relationships can be global, local, or composition; lexical relationships can be synonymy, antonymy, hyponymy / hypernymy, or meronymy / holonymy; and predicative relationships can be actions (events) or states.

A method and system are provided for tagging, indexing, searching, retrieving, manipulating, and editing video images on a wide area network such as the Internet. A first set of methods is provided for enabling users to add bookmarks to multimedia files, such as movies, and audio files, such as music. The multimedia bookmark facilitates the searching of portions or segments of multimedia files, particularly when used in conjunction with a search engine. Additional methods are provided that reformat a video image for use on a variety of devices that have a wide range of resolutions by selecting some material (in the case of smaller resolutions) or more material (in the case of larger resolutions) from the same multimedia file. Still more methods are provided for interrogating images that contain textual information (in graphical form) so that the text may be copied to a tag or bookmark that can itself be indexed and searched to facilitate later retrieval via a search engine.

A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video / audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include a non-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video to generate an output video that tracks a particular individual or object of interest.

An analytical recognition system includes one or more video cameras configured to capture video and a video analytics module configured to perform real-time video processing and analyzation of the captured video and generate non-video data. The video analytic module includes one or more algorithms configured to identify an abnormal situation. Each abnormal situation alerts the video analytics module to automatically issue an alert and track one or more objects or individuals by utilizing the one or more video cameras. The abnormal situation is selected from the group consisting of action of a particular individual, non-action of a particular individual, a temporal event, and an externally generated event.

The invention provides for quickly browsing through a large set of video clips to locate video clips of interest. In an embodiment of the present invention, hierarchical clustering of the video clips can be undertaken enabling the user to successively identify the subgroup of video clips of interest. This approach generates a video summary for the contents of each cluster by selecting representative video clips from individual videos and lower level clusters within the cluster. Links are added between the more general, higher-level clusters and the elements they contain. Thus, starting at the top of the set of videos being browsed or returned by the search engine and continuing at each subsequent cluster level, the user is presented with video summaries for the relevant parts of videos and those of next lower-level clusters. The user can then follow the navigational link to the desired video or lower-level cluster.

A spherical content capture system captures spherical video content. A spherical video sharing platform enables users to share the captured spherical content and enables users to access spherical content shared by other users. In one embodiment, captured metadata or video / audio processing is used to identify content relevant to a particular user based on time and location information. The platform can then generate an output video from one or more shared spherical content files relevant to the user. The output video may include anon-spherical reduced field of view such as those commonly associated with conventional camera systems. Particularly, relevant sub-frames having a reduced field of view may be extracted from each frame of spherical video o generate an output video that tracks a particular individual or object of interest.