Reproducing Apparatus Offset Metadata TS Packet Structure

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Transforming a stream of main images into TS packets without a specific method makes it impossible to decode using a general-purpose decoder, requiring a dedicated decoder and hindering easy realization of 3D display for sub-images.

Innovation Solution

The proposed solution involves a reproducing apparatus with an offset generating unit that extracts and decodes offset information from TS packets, allowing for the generation of 3D display data by shifting caption and menu data based on offset information, enabling easy 3D display of sub-images alongside main images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If the stream of main images is transformed into TS packets without using a specific method, then the decoding process becomes simpler, but it becomes impossible to decode the stream using a general-purpose decoder and requires a dedicated decoder

Engineering Contradiction:
Improveease of decodingVSAvoiddecoder complexity
Core Design Contradiction:
Ease of manufactureVSDevice complexity

Solution Approach 1:

The patent applies universality by designing the TS packet structure to be compatible with general-purpose decoders while still supporting the specific functionality of carrying both main image data and offset information for sub-images. The transport stream format follows standard conventions, allowing the same decoder infrastructure to handle both conventional video streams and the enhanced streams with embedded offset metadata, thereby eliminating the need for dedicated decoders.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If offset information is arranged in the stream of main images, then 3D display of sub-images can be realized, but the decoding process becomes more complex and requires extraction and processing of offset information

Engineering Contradiction:
Improve3D display capabilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by separating the offset information from the main image data stream and organizing it into distinct TS packets with specific PID (Packet ID) identifiers. This allows the offset information to be extracted independently using PID filtering, and processed separately through an offset information processing unit, reducing the complexity of processing the main image stream while still enabling 3D display functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary structure in the form of dedicated TS packets with specific PID values that carry offset information. These intermediary packets act as a mediator between the main image stream and the 3D display processing units, allowing offset information to be transmitted and processed without interfering with the main image decoding process, thus simplifying the overall system architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If a dedicated decoder is prepared to handle the stream with offset information, then 3D display can be achieved, but development cost increases

Engineering Contradiction:
Improve3D display functionalityVSAvoiddevelopment cost
Core Design Contradiction:
Adaptability or versatilityVSEase of manufacture

Solution Approach 1:

The patent applies universality by designing the transport stream format and packet structure to be compatible with existing general-purpose video decoders. The TS packet headers, PID filtering mechanisms, and data organization follow standard conventions, allowing the same decoder infrastructure to handle both conventional video streams and streams with embedded offset information for sub-images, thereby eliminating the need for expensive dedicated decoders.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentEP2337368B1Reproducing device, reproducing method, data structure, recording medium, recording device, recording method, and program
Publication Date: 2015.11.04 SONY GROUP CORP
  • EP2337368B1 patent drawingFigure 1
  • EP2337368B1 patent drawingFigure 2
  • EP2337368B1 patent drawingFigure 3

AI summary

The present invention relates to a reproducing apparatus and a reproducing method, a data structure, a recording medium, a recording apparatus and a recording method, and a program that enable, in a case where offset information of a sub-image is arranged in a stream of a main image, easy realization of 3D display of the sub-image based on the offset information. A right-eye video stream includes offset metadata for generating offset information. In a data portion of each TS packet of the right-eye video stream, only any one of video data of an encoded right-eye main image and offset metadata is arranged. In a header of each TS packet of the right-eye video stream, transport priority, which indicates whether data arranged in the data portion of the TS packet is video data of an encoded right-eye main image or offset metadata, is described. The present invention can be applied to, for example, a reproducing apparatus that displays a sub-image in a 3D manner.