Video Encoding Subset Strategy for Power-Constrained Surveillance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Image processing devices, such as battery-powered cameras, face limitations in power and bitrate for continuous video encoding and transmission, particularly in surveillance applications where resources are constrained.
Innovation Solution
A method and device that encode a subset of image frames at a reduced bitrate and frame rate in real-time, storing the remaining frames for complete encoding later when more resources are available, using a hierarchical frame structure with a base and enhancement layer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If continuous video encoding is performed at full frame rate, then video quality and completeness are improved, but energy consumption and bitrate requirements increase
Solution Approach 1:
The video encoding process is segmented into two distinct phases: a first phase where a subset of frames is encoded at full quality during capture, and a second phase where remaining frames are encoded later using stored data. This segmentation allows the system to manage energy consumption by performing intensive encoding operations only when necessary, rather than continuously encoding all frames at full quality.
Solution Approach 2:
The system performs preliminary actions by storing raw or partially processed video frames in memory during the capture phase, rather than encoding them immediately. This preliminary storage allows the encoding operation to be deferred to a later time when energy resources may be more available, reducing immediate energy consumption while preserving the ability to complete full encoding later.
2Reliability
If continuous video encoding is performed at full bitrate, then video quality is improved, but bandwidth requirements and power consumption increase
Solution Approach 1:
The encoding process is divided into segments where only a subset of frames requires high-quality encoding during the capture phase, while other frames are encoded later. This segmentation reduces the instantaneous bitrate and power consumption during capture, as the system only processes a portion of frames at full quality rather than all frames continuously.
Solution Approach 2:
The system extracts the encoding operation from the continuous capture process. By separating the encoding function from the real-time capture flow, the system can perform encoding selectively on a subset of frames during capture, while deferring encoding of remaining frames to a later batch processing stage, thereby reducing instantaneous power and bitrate requirements.
3Reliability
If all video frames are encoded in real-time, then video completeness is improved, but processing resources and energy are depleted
Solution Approach 1:
The video processing workflow is segmented into distinct stages: a first stage where a subset of frames is encoded during capture, and a second stage where remaining frames are encoded using stored data. This segmentation improves processing efficiency by allowing the system to manage resource allocation across different time periods, performing intensive processing operations when resources are available rather than depleting them continuously.
Solution Approach 2:
The system performs preliminary storage of video frames in memory during the capture phase, preparing data for later encoding operations. This preliminary action allows the system to defer resource-intensive encoding operations to a later time, improving immediate processing efficiency while ensuring that all frames will ultimately be encoded for complete video output.
Data Source
Figure 1
Figure 2a~2d
Figure 3
AI summary
A method and image processing device (100) for encoding a video comprising a sequence of image frames captured between a first and a second time is disclosed. The method comprises encoding (10) a subset of the image frames, wherein the image frames of the subset are distributed over the sequence and storing (20) the remaining image frames of the sequence. After the second time, the encoded subset is decoded (30) and the stored remaining image frames as well as the decoded encoded subset are encoded (32) to generate the encoded video. Alternatively, the stored remaining image frames are encoded (40) and the encoded subset added (42) to generate the encoded video.