Transmission Device Frame Interpolation Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Frame interpolation on the reception side can hinder the accurate reflection of the intended content in moving image data, disrupting the original production intent.

Innovation Solution

A transmission system that inserts information for restricting frame interpolation into the transport stream and video stream, preventing frame interpolation on the reception side by controlling frame rate conversion based on this information, using descriptors and SEI messages to ensure accurate representation of the original frame rate.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If frame interpolation is performed on the reception side to increase frame rate, then the display frame rate is improved, but the accuracy of reflecting the original production intent deteriorates

Engineering Contradiction:
Improveframe rateVSAvoidaccuracy of production intent
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The transmission side performs frame interpolation in advance and transmits the interpolated frames as if they were originally captured frames. This preliminary action allows the reception side to display at higher frame rates without performing additional interpolation, thus preserving the accuracy of the production intent while achieving high frame rate display

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The transmission side acts as an intermediary by performing frame interpolation and embedding indicators in the transmitted stream. This intermediary action prevents the reception side from performing its own interpolation, ensuring that only the transmission side's controlled interpolation is displayed, thereby maintaining accuracy of the production intent

Inventive Principle:
Principle #24Intermediary (Mediator)

2Stability of the object's composition

If frame interpolation is performed on the reception side, then the smoothness of motion is improved, but the fidelity to the original content deteriorates

Engineering Contradiction:
Improvesmoothness of motionVSAvoidfidelity to original content
Core Design Contradiction:
Stability of the object's compositionVSReliability

Solution Approach 1:

The transmission side performs frame interpolation in advance to create smooth motion sequences, then transmits these pre-interpolated frames with indicators. This ensures that the smoothness is achieved through controlled interpolation while preventing unauthorized interpolation at the reception side that would compromise content fidelity

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The transmission side embeds indicators in the transmitted stream that provide feedback to the reception side about whether interpolation has already been performed. This feedback mechanism allows the reception side to adjust its processing accordingly, maintaining both smoothness and fidelity to the original content

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3300374B1Transmission device, transmission method, image processing device, image processing method, receiving device, and receiving method
Publication Date: 2022.07.06 SONY GROUP CORP
  • EP3300374B1 patent drawingFigure 1~2
  • EP3300374B1 patent drawingFigure 3
  • EP3300374B1 patent drawingFigure 4

AI summary

This is provided to achieve capability of avoiding hindrance of accurate reflection of intention at the time of production due to execution of frame interpolation on the reception side. A predetermined container including a video stream obtained by performing encoding operation on moving image data of a predetermined frame rate is transmitted. Information for restricting frame interpolation is inserted into one or both of a layer of the container and a layer of the video stream. For example, the information for restricting frame interpolation includes information for prohibiting frame interpolation. Moreover, for example, the information for restricting frame interpolation includes information indicating the number of times of frame repeats.