Surveillance Thumbnail Generation Triggered by Sound Events
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video surveillance systems face challenges in detecting objects and events of interest before they are captured by cameras and in presenting relevant thumbnails for video streams or files, particularly in response to sound events, which can lead to missed detections and inefficient data presentation.
Innovation Solution
A method and system that utilize audio streams or files to generate thumbnails based on detected sound events, incorporating sound event detection, distance calculation, and time correction to select frames from video streams or files, allowing for quick visual representation of objects or events of interest.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video cameras record video data continuously or based on motion detection, then objects and activities can be captured, but recording may start after objects have already moved out of the field-of-view or detection is too late
Solution Approach 1:
The system performs preliminary detection using acoustic sensors that detect sound events before visual capture is needed. By detecting sound events (such as glass breaking, alarms, or other notable sounds) in advance, the system can trigger video recording at the precise moment the event occurs, ensuring the object or activity is captured within the field-of-view rather than after it has moved away. This preliminary acoustic detection resolves the timing issue between detection and visual capture.
2Ease of operation
If video streams or files are stored and accessed based on metadata or video content analysis, then relevant video can be found, but the process is time-consuming and requires significant processing
Solution Approach 1:
The system introduces acoustic event detection as an intermediary layer between the video capture and the retrieval process. Instead of searching through video content or metadata directly, the system uses detected sound events as triggers that automatically generate thumbnails and initiate retrieval. This intermediary acoustic detection layer simplifies the operator's task (improving ease of operation) while reducing search time, as the system proactively identifies and presents relevant video segments based on acoustic cues rather than requiring manual browsing or complex video analysis.
Solution Approach 2:
The system replaces traditional video-based detection and search mechanisms with acoustic event detection. Instead of relying on motion detection algorithms or manual video scanning, the system uses acoustic sensors to detect sound events that trigger video retrieval. This substitution reduces processing time and computational requirements while improving the speed and efficiency of video retrieval operations.
3Productivity
If thumbnails are generated from video frames, then visual representation is provided, but the thumbnails may not correspond to important events or objects of interest
Solution Approach 1:
The system uses acoustic event detection as feedback to determine when and what thumbnails to generate. When a sound event is detected (such as an alarm, glass breaking, or other notable sound), the system generates a thumbnail from the corresponding video frame at that precise moment. This feedback mechanism ensures that thumbnails are not generated arbitrarily but are directly tied to important events detected through acoustic cues, thereby preserving event relevance information while maintaining efficient thumbnail generation.
Solution Approach 2:
The system performs preliminary acoustic detection to identify important events before generating thumbnails. By detecting sound events in advance and using them as triggers for thumbnail generation, the system ensures that thumbnails correspond to significant moments in the video stream. This preliminary acoustic analysis preserves the relevance of events in the generated thumbnails while maintaining efficient processing.
Data Source
AI summary
A computer-implemented method of generating a thumbnail of a video stream or file of a surveillance area in a video management system, including setting, in the video management system, at least one sound event to be detected in at least one audio stream or file corresponding to the video stream or file; detecting, in the at least one audio stream or file, at least one point in time at which the at least one sound event occurs; generating the thumbnail based on at least part of at least one frame of the video stream or file, wherein the frame is selected based on the point in time; and displaying the thumbnail in the video management system.