System and method for managing video, image and activity data

Abstract

A computer-implemented method for an object and activity query language wherein an object is a data type representing a thing or a being with a visual shape in an image or video frame and said activity is a data type representing an action or an event visually shown in an image or video or video frame, the method comprising the steps of storing a plurality of items in a raw data storage, said items comprising images and / or videos, processing said items in a processor and to generate and / or segment annotated information from said items and to extract object, activity and / or metadata information from said items in said first data storage, storing said annotated information in a secondary data storage, storing said extracted object, activity, and / or metadata information and said annotated information in a primary data storage, executing on a processor an identify function, wherein given a query item said identify function identifies said query item and / or finds a list of items similar to said first item; and a said query item comprises a video, a video frame, an image, a set of images, a template extracted from a video or image or images, an object, an activity, or annotated information, and displaying results of said identify function.

Description

CROSS-REFERENCE TO RELATED APPLICATIONS[0001]The present application claims the benefit of the filing date of U.S. Provisional Patent Application Ser. No. 61 / 098,212 entitled “System and Method for Managing Video, Image and Activity Data” filed by the present inventor on Sep. 18, 2009.[0002]Other patents and applications included material related to varying degrees include the following: “Invariant Memory Page Pool and Implementation Thereof,” U.S. Pat. No. 6,912,641 granted on Jun. 28, 2005; “Memory-Resident Database Management System and Implementation Thereof,” U.S. Pat. No. 7,318,076 granted on Jan. 8, 2008; “Distributed Memory Computing Environment and Implementation Thereof; U.S. Pat. No. 7,043,623, granted on May 9, 2006; “Image Indexing Search and Implementation Thereof,” U.S. Pat. No. 7,184,577 granted on Feb. 27, 2007; “Apparatus and Method for Biometric Database Management System,” U.S. Patent Application Publication No. US 2005 / 0223016 published on Oct. 6, 2005; and “Dat...

AI Technical Summary

Benefits of technology

[0008]The invention also presents a dedicated query language built within a system for flexible query into the system. The query language may be built as an SQL extension such that it has similar query style as standard SQL for fast training and low ownership cost. Therefore a query language parser will be built into the system to parse the query language into token stream that will trigger the internal execution of OA Data search.

[0015]The method additionally may further comprise the steps of providing a graphic user interface on a display, wherein graphic symbols are used to visually represent objects or activities. The graphic symbols additional may comprise object graphic symbols representing a thing or a being with visual shape in an image or video frame. The graphic query interface translates the graphic symbols entered by a user into query statements executed on the processor and displays a query result. The graphic query interface may combine multiple graphic symbols to form a query statement for a complex activity. The graphic user interface further may provide logic symbols, such as AND, OR, NOR or other known symbols, permitting a user to form logical relationships between sub-statements.

Problems solved by technology

This functionality when extended into other data processing (especially unstructured data processing) has proven to be limited and unsuccessful.

As additional enhanced functionality is integrated into the database architecture it makes the database administration and maintenance even more complicated and therefore more costly.

Relational databases are good for management of structured text-based information, but they are not good for video, image and unstructured or semi-unstructured information extracted from image and video on object and activity.

Images