System and method for managing video, image and activity data

Abstract

A computer-implemented method for an object and activity query language wherein an object is a data type representing a thing or a being with a visual shape in an image or video frame and said activity is a data type representing an action or an event visually shown in an image or video or video frame, the method comprising the steps of storing a plurality of items in a raw data storage, said items comprising images and/or videos, processing said items in a processor and to generate and/or segment annotated information from said items and to extract object, activity and/or metadata information from said items in said first data storage, storing said annotated information in a secondary data storage, storing said extracted object, activity, and/or metadata information and said annotated information in a primary data storage, executing on a processor an identify function, wherein given a query item said identify function identifies said query item and/or finds a list of items similar to said first item; and a said query item comprises a video, a video frame, an image, a set of images, a template extracted from a video or image or images, an object, an activity, or annotated information, and displaying results of said identify function.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS[0001]The present application claims the benefit of the filing date of U.S. Provisional Patent Application Ser. No. 61 / 098,212 entitled “System and Method for Managing Video, Image and Activity Data” filed by the present inventor on Sep. 18, 2009.[0002]Other patents and applications included material related to varying degrees include the following: “Invariant Memory Page Pool and Implementation Thereof,” U.S. Pat. No. 6,912,641 granted on Jun. 28, 2005; “Memory-Resident Database Management System and Implementation Thereof,” U.S. Pat. No. 7,318,076 granted on Jan. 8, 2008; “Distributed Memory Computing Environment and Implementation Thereof; U.S. Pat. No. 7,043,623, granted on May 9, 2006; “Image Indexing Search and Implementation Thereof,” U.S. Pat. No. 7,184,577 granted on Feb. 27, 2007; “Apparatus and Method for Biometric Database Management System,” U.S. Patent Application Publication No. US 2005 / 0223016 published on Oct. 6, 2005; and “Dat...

AI Technical Summary

Benefits of technology

[0056]Referring to FIG. 5, similarly a query can be formed by grabbing objects symbols 501, activity symbols 503 and logic symbols 505 to make query into the database of objects and activities. The shown example in FIG. 5 is to query / search all instances (of video-clip and / or images) from the database of objects and activities that have activities of either “person entering vehicle” or “person leaving vehicle”507 (symbolic) and 509 (texted). Other query language functions such as compose( ) or identify( ) can be added in the graphic query interface to achieve more flexible query experience.

Problems solved by technology

This functionality when extended into other data processing (especially unstructured data processing) has proven to be limited and unsuccessful.

As additional enhanced functionality is integrated into the database architecture it makes the database administration and maintenance even more complicated and therefore more costly.

Relational databases are good for management of structured text-based information, but they are not good for video, image and unstructured or semi-unstructured information extracted from image and video on object and activity.

Images