Encoded Video Stream Event Frame Insertion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

When a camera or connection fails, the video stream is interrupted, and viewers are unaware of the reason, as they cannot distinguish between changes in camera operation state or connection state without additional visual cues.

Innovation Solution

Adding one or a sequence of additional image frames to the video stream that code a predetermined visual change relative to the preceding frame, indicating the type of detected event, such as camera shutdown or connection failure, allowing viewers to identify the cause of the interruption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If additional image frames are added to indicate event types, then information completeness is improved, but device complexity increases

Engineering Contradiction:
Improveinformation completenessVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The video stream is segmented by inserting additional image frames between regular video frames. These additional frames are specifically designed to carry event type information through visual patterns, separating the information-carrying function from the regular video content frames.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The additional image frames utilize predetermined visual changes such as color changes, brightness changes, or pattern changes relative to the preceding frame to encode event type information. For example, a specific color shift or brightness level indicates a particular event type, allowing information transmission through visual properties rather than requiring complex data structures.

Inventive Principle:
Principle #32Color changes

2Loss of information

If additional image frames are added to indicate event types, then information completeness is improved, but data transmission volume increases

Engineering Contradiction:
Improveinformation completenessVSAvoiddata transmission volume
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

Instead of transmitting full event metadata for every frame, the system uses partial action by only adding additional frames when events occur. The additional frames contain minimal visual information (predetermined patterns) rather than complete event data, reducing the overhead compared to transmitting full event descriptions.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The visual patterns used in additional frames are predetermined and pre-agreed upon between encoder and decoder. This preliminary action establishes a codebook of visual patterns that map to event types, eliminating the need to transmit the actual event type data and reducing transmission volume.

Inventive Principle:
Principle #10Preliminary action

3Loss of information

If visual patterns are used to indicate event types, then information completeness is improved, but difficulty of detecting and measuring increases

Engineering Contradiction:
Improveinformation completenessVSAvoiddifficulty of detecting and measuring
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The solution uses distinct color changes, brightness changes, or visual patterns in the additional frames that are easily distinguishable from normal video content. These predetermined visual changes create clear, measurable differences that can be detected by simple image analysis in the decoder without requiring complex event recognition algorithms.

Inventive Principle:
Principle #32Color changes

Data Source

PatentUS12170781B2System and method for adding one additional image frame or a sequence of additional image frames to a stream of encoded image frames
Publication Date: 2024.12.17 AXIS
  • US12170781B2 patent drawing
  • US12170781B2 patent drawing

AI summary

A method for adding at least one additional image frame to a stream of encoded image frames, the stream of encoded image frames comprising image frames encoded by an encoder. An event relating to at least one of: i) a change of operation state of a sender of the stream of encoded image frames, or ii) a change of connection state between the sender and a receiver is detected. Depending on the type of the detected event, the at least one additional image frame is provided. Each at least one additional image frame comprises a reference to a preceding image frame and codes a predetermined visual change relative to the preceding image frame. The predetermined visual change is indicative of the type of the detected event. The at least one additional image frame is added to the stream of encoded image frames to obtain a combined stream of image frames.