Video Object Search Using Motion Direction and Interest Points
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video surveillance systems face challenges in efficiently processing and storing high-resolution video streams from multiple cameras, leading to increased CPU power, bandwidth, and storage requirements, as well as difficulties in locating and splicing together video segments of interest across multiple camera feeds.
Innovation Solution
A method and system that capture and store video from multiple scenes, process the video to determine the direction of motion of an object of interest, and selectively search and link relevant video segments across storage elements to generate a contiguous video stream, utilizing direction of motion and probability tables to optimize the search process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If high resolution video is captured and stored from multiple cameras, then image detail is improved, but CPU power, bandwidth, and storage space requirements increase
Solution Approach 1:
The patent extracts and stores only the most important visual information from video frames using interest point detection and description. Instead of storing complete high-resolution video frames, the system extracts key features (interest points with descriptors) that capture essential visual content, significantly reducing storage requirements while preserving image detail for recognition and retrieval purposes
Solution Approach 2:
The patent creates simplified representations (copies) of video content in the form of interest point descriptors. These descriptors are compact data structures that replicate the essential visual information of video frames without requiring the full original video data, enabling efficient storage and processing while maintaining the ability to identify and retrieve relevant video segments
2Area of stationary object
If complete video streams from multiple cameras are processed and stored, then video coverage is improved, but processing time and computational resources increase
Solution Approach 1:
The patent performs preliminary processing of video streams by detecting and storing interest points and their descriptors as video data is captured. This advance preparation creates an indexed structure of key visual features that can be quickly queried later, eliminating the need to process complete video streams when searching for specific content, thus significantly reducing processing time while maintaining comprehensive video coverage
Solution Approach 2:
The patent segments video data into discrete interest points with associated descriptors and spatial-temporal information. By dividing continuous video streams into identifiable feature segments, the system enables targeted processing and search operations on specific segments rather than processing entire video streams, reducing overall processing time while maintaining comprehensive coverage across multiple cameras
3Loss of information
If video segments from multiple cameras are searched and spliced together, then contiguous video of moving objects is improved, but system complexity increases
Solution Approach 1:
The patent uses feedback mechanisms where interest point descriptors from one video segment inform the search strategy for subsequent segments. The system compares descriptors across camera feeds and uses matching results to guide the splicing process, automatically identifying and linking video segments that contain continuous tracking of moving objects. This feedback-driven approach simplifies the complexity of multi-camera video correlation by using automated feature matching rather than manual or brute-force methods
Data Source
AI summary
A method of searching for objects of interest within captured video comprising capturing video of a plurality of scenes, storing the video in a plurality of storage elements, and receiving a request to retrieve contiguous video of an object of interest that has moved through at least two scenes of the plurality of scenes. In response to the request, searching within a first storage element of the plurality of storage elements to identify a first portion of the video that contains the object of interest within a first scene of the plurality of scenes, processing the first portion of the video to determine a direction of motion of the object of interest, selecting a second storage element of the plurality of storage elements within which to search for the object of interest based on the direction of motion, searching within the second storage element to identify a second portion of the video that contains the object of interest within a second scene of the plurality of scenes, and linking the first portion of the video with the second portion of the video to generate the contiguous video of the object of interest.