Tile-Based Video Distribution System for Fast Region-of-Interest Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image capturing systems face challenges in shortening video switching time while managing bandwidth efficiently, particularly when a region of interest is designated by a client, as the current techniques do not effectively adapt the frame interval of intra-frame compression to reduce switching time without increasing communication bandwidth.

Innovation Solution

An image capturing system that includes an image capturing apparatus and a distribution apparatus, where the apparatus can divide video images into tiles of varying resolutions, encode them using intra-frame and inter-frame compression, and dynamically adjust the frame interval of intra-frame compression based on the frequency of tile designation by a client, allowing for efficient distribution of video streams.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If intra-frame compression is performed frequently to reduce video switching time, then switching speed is improved, but communication bandwidth is increased

Engineering Contradiction:
Improvevideo switching timeVSAvoidcommunication bandwidth
Core Design Contradiction:
SpeedVSLoss of energy

Solution Approach 1:

The patent applies local quality by differentiating compression settings for different tiles based on their importance. Tiles corresponding to regions of interest use intra-frame compression with shorter intervals, while other tiles use inter-frame compression with longer intervals. This allows the system to reduce switching time for important regions without increasing bandwidth for the entire video stream.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically adjusts the frame interval for intra-frame compression based on the number of times a tile is designated as a region of interest. The encode control unit changes the frame interval of intra-frame compression frames according to the designation frequency, making the compression strategy adaptive rather than static. This dynamic adjustment optimizes the balance between switching time and bandwidth usage.

Inventive Principle:
Principle #15Dynamics

2Loss of time

If the frame interval of intra-frame compression is shortened for all tiles, then video switching time is reduced, but the code amount of video images increases

Engineering Contradiction:
Improvevideo switching timeVSAvoidcode amount of video images
Core Design Contradiction:
Loss of timeVSQuantity of substance

Solution Approach 1:

The patent segments the video image into multiple tiles and applies different compression strategies to each tile. Instead of uniformly applying intra-frame compression to all tiles, the system divides them into regions of interest (using intra-frame compression) and other regions (using inter-frame compression). This segmentation allows selective optimization of switching time without globally increasing code amount.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes compression parameters (frame interval for intra-frame compression) based on tile designation frequency. Tiles that are frequently designated as regions of interest have shorter intra-frame compression intervals, while less important tiles maintain longer intervals or use inter-frame compression. This parameter differentiation reduces overall code amount while still achieving fast switching for important regions.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11570492B2Image capturing system, distribution apparatus, image capturing apparatus, control method, and non-transitory computer-readable storage medium
Publication Date: 2023.01.31 CANON KK
  • US11570492B2 patent drawing
  • US11570492B2 patent drawing
  • US11570492B2 patent drawing

AI summary

This invention provides a system including an image capturing apparatus and a distribution apparatus, wherein the image capturing apparatus includes an image capturing unit capturing images of a plurality of resolutions, a dividing unit dividing each of the images into tiles having a preset size, an encoding unit encoding images, and an output unit outputting encoded data to the distribution apparatus, and wherein the distribution apparatus includes a distributing unit distributing, as a video stream, encoded data of a tile requested by a client on a network to the client, and an encode control unit changing a frame interval of intra-frame compression of a tile corresponding to a region of interest requested from a client on a network, in accordance with the number of times of designation of the tile, and setting the changed in the encoding unit.