Camera Image Encoding via Oscillation Frequency Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Video encoding for body-worn cameras faces limitations due to battery power constraints and limited bitrate for wireless transmission, particularly when the camera undergoes periodic movements, leading to increased bitrate requirements and storage needs.

Innovation Solution

A method that identifies a base subset of images corresponding to the oscillation frequency of periodic camera movements, encoding these into an encoded video stream comprising intra and inter frames, allowing for reduced bitrate by omitting non-essential movement-related frames, and adaptively transmitting either the base subset or additional subsets based on available bandwidth.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If all images in the image sequence are encoded using conventional encoding, then complete video content is preserved, but bitrate increases significantly due to periodic camera movements

Engineering Contradiction:
Improvevideo content completenessVSAvoidbitrate
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The image sequence is segmented into a base subset of images and additional subsets. The base subset contains images at positions corresponding to the oscillation frequency (where camera movement is minimal), while additional subsets contain images captured in-between. This segmentation allows selective encoding to reduce bitrate while preserving essential content.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The periodic movement component is extracted and identified through oscillation frequency detection. By identifying which images are affected by periodic movement and separating them into additional subsets, the encoding process can focus resources on the base subset where content is most stable and important, reducing overall bitrate requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

2Adaptability or versatility

If camera moves periodically during capture, then dynamic scene coverage is improved, but motion estimation fails and intra encoding is required increasing bitrate

Engineering Contradiction:
Improvescene coverageVSAvoidbitrate
Core Design Contradiction:
Adaptability or versatilityVSQuantity of substance

Solution Approach 1:

The invention leverages the periodic nature of camera movement by detecting the oscillation frequency. Images are selected at specific periodic intervals (at the oscillation frequency) where the camera returns to similar positions, creating a base subset with minimal movement between consecutive images. This allows inter-encoding to succeed and reduces bitrate while maintaining scene coverage through additional subsets.

Inventive Principle:
Principle #19Periodic action

3Use of energy by moving object

If wireless transmission bandwidth is limited, then power consumption is reduced, but video quality and completeness suffer

Engineering Contradiction:
Improvepower consumptionVSAvoidvideo quality
Core Design Contradiction:
Use of energy by moving objectVSLoss of information

Solution Approach 1:

The encoding approach is made dynamic by adaptively selecting between transmitting only the base subset (lower bitrate, lower power) or transmitting both base and additional subsets (higher bitrate, higher power) based on available bandwidth conditions. This dynamic adaptation allows the system to optimize the trade-off between power consumption and video quality according to real-time transmission capabilities.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11750798B2Image processing device and a method for encoding images captured by a camera
Publication Date: 2023.09.05 AXIS
  • US11750798B2 patent drawing
  • US11750798B2 patent drawing
  • US11750798B2 patent drawing

AI summary

The present invention relates to the field of video encoding. In particular, it relates to a method 300 of encoding images captured by a camera and to an image processing device. An image sequence captured with an image sensor of the camera is obtained S310, and an oscillation frequency of a periodic movement of the camera during capturing of the image sequence is determined S320. A base subset of images of the image sequence corresponding to the oscillation frequency is identified S330 and the base subset of images are encoded S340 into an encoded video stream comprising intra frames and inter frames.