Video Summarization System for Synchronized Multi-Camera Frame Retrieval

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing security camera systems face challenges in efficiently reviewing large amounts of video data to identify specific frames of interest, as they often require sequential playback and struggle to retrieve and display synchronized video streams simultaneously, leading to high data storage requirements and user inefficiency.

Innovation Solution

A video summarization system that includes a user input device, communications interface, processing circuit, and display device, which allows users to request and retrieve specific video frames based on timestamps, storing them in a local database while maintaining the full frames in a remote database, enabling synchronized playback and reducing storage needs by using analytics cues like motion detection.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If sequential playback is used to review video data, then user can identify frames of interest, but time consumption increases and efficiency decreases

Engineering Contradiction:
Improvetime to identify frames of interestVSAvoiduser efficiency in reviewing video data
Core Design Contradiction:
Loss of timeVSProductivity

Solution Approach 1:

The system performs preliminary actions by pre-processing video data to extract key features, generate summaries, and create searchable metadata before user review. This allows the system to quickly present relevant frames based on user queries without requiring sequential playback of entire video streams.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary processing layer between the video data and user interface. This intermediary system generates video summaries, extracts key frames, and creates searchable indices that mediate between the raw video data and user review needs, enabling efficient frame identification without direct sequential playback.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Speed

If full video frames are stored locally for quick access, then retrieval speed improves, but storage requirements increase

Engineering Contradiction:
Improvevideo frame retrieval speedVSAvoiddata storage capacity
Core Design Contradiction:
SpeedVSQuantity of substance

Solution Approach 1:

The patent segments video data into different components: full-resolution frames are stored remotely, while locally the system stores compressed representations, key frames, and metadata. This segmentation allows quick access to essential information locally while maintaining full-quality storage remotely, balancing speed and storage requirements.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system creates compressed copies and summaries of video frames for local storage instead of storing full-resolution frames. These copies include key extracted features and metadata that enable quick retrieval and identification, while the complete frames remain stored remotely for when full quality is needed.

Inventive Principle:
Principle #26Copying

3Adaptability or versatility

If multiple video streams are retrieved and displayed simultaneously, then user can compare footage across cameras, but system complexity and processing requirements increase

Engineering Contradiction:
Improveability to view multiple video streams simultaneouslyVSAvoidsystem complexity for synchronized playback
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent merges multiple video streams into a unified summary view that displays key frames from multiple cameras simultaneously. By combining the streams at the summary level rather than requiring synchronized playback of full streams, the system enables multi-camera comparison while reducing processing complexity.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS20240364846A1Video summarization systems and methods
Publication Date: 2024.10.31 TYCO FIRE & SECURITY GMBH
  • US20240364846A1 patent drawing
  • US20240364846A1 patent drawing
  • US20240364846A1 patent drawing

AI summary

A video summarization device includes a user input device, a communications interface, a processing circuit, and a display device. The user input device receives a first request to view a plurality of video streams including an indication of a first time associated with the plurality of video streams. The processing circuit transmits, via the communications interface, a second request to retrieve a plurality of image frames based on the indication of the first time to at least one of a first database and a second database. The processing circuit receives, from the at least one of the first database and the second database, the plurality of image frames. The processing circuit provides, to the display device, a representation of a plurality of video stream objects corresponding to the plurality of image frames received from the at least one of a first database and a second database.