Media Data Segmentation for Real-Time 8K Decoding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods face challenges in decoding ultra-high definition moving images, such as 8K, in real time due to high processing loads, particularly when using a single decoder, and lack efficient methods for demultiplexing and distributing encoded data across multiple decoders.

Innovation Solution

The method involves dividing an access unit into tiles and slice segments, allowing for parallel decoding by distributing each slice segment to a separate decoder, and using fragment counters in header information to manage and identify packetized data, enabling efficient demultiplexing and real-time processing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If encoded data is transmitted using current MMT methods without division sequence numbers, then the transmission structure is simple, but the receiving device cannot uniquely specify division sequence numbers of divided data items, making efficient demultiplexing impossible

Engineering Contradiction:
Improvedemultiplexing efficiencyVSAvoidheader information structure
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the media data into multiple divided data items and transmits each as a separate packet. Each packet's header includes a division sequence number that uniquely identifies its position in the original media data sequence. This segmentation enables the receiving device to efficiently demultiplex and reorder packets without complex analysis, directly resolving the contradiction between demultiplexing efficiency and header structure complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The division sequence number is embedded in the header information during the transmission preparation phase, before the receiving device needs to perform demultiplexing. This preliminary inclusion of ordering information allows the receiving device to immediately identify and reorder packets without performing complex analysis, thereby improving demultiplexing efficiency while maintaining a relatively simple header structure.

Inventive Principle:
Principle #10Preliminary action

2Productivity

If a single decoder is used for ultra-high definition moving images, then the device configuration is simple, but the processing load becomes too high to decode in real time

Engineering Contradiction:
Improvedecoding speedVSAvoiddecoder configuration
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent divides the encoded media data into multiple segments corresponding to different division sequence numbers, and distributes these segments to multiple decoders for parallel processing. Each decoder handles a specific portion of the data, which reduces the processing load on individual decoders and enables real-time decoding of ultra-high definition content. The segmented approach directly addresses the contradiction between decoding speed and device complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from single-thread sequential decoding to multi-thread parallel decoding by introducing the dimension of multiple decoders working simultaneously. Each decoder operates on different divided data items in parallel, effectively increasing the overall decoding throughput without requiring a single overly complex decoder. This dimensional expansion resolves the contradiction between productivity and device complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Reliability

If media data is divided into multiple packets for transmission, then the transmission flexibility and error resilience improve, but the receiving device lacks information to correctly reassemble the divided data in the proper sequence

Engineering Contradiction:
Improvedata transmission reliabilityVSAvoiddivision sequence information
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The division sequence number is embedded in the header information of each packet during the transmission preparation phase, before the packets are sent. This preliminary inclusion of sequence information ensures that even if packets arrive out of order or some are lost, the receiving device can correctly identify and reassemble them in the proper sequence, thereby maintaining reliability without losing division sequence information.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The division sequence number acts as a feedback mechanism that provides ordering information to the receiving device. Each packet carries its position information in the original sequence, enabling the receiving device to reconstruct the media data correctly even when transmission conditions are adverse. This feedback mechanism resolves the contradiction between transmission reliability and information loss.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3179730B1Transmission method, reception method, transmission device, and reception device
Publication Date: 2021.10.06 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • EP3179730B1 patent drawingFigure 1
  • EP3179730B1 patent drawingFigure 2
  • EP3179730B1 patent drawingFigure 3~4

AI summary

A transmitting method according to one aspect of the present disclosure includes: dividing media data into a plurality of items of divided data; configuring a plurality of packets by allocating the header information to each of a plurality of items of divided data and packetizing a plurality of items of divided data; and transmitting a plurality of configured packets, and, in the transmitting, (i) divided data information and (ii) a value of the invalidated fragment counter are transmitted, where the divided data information is information for specifying divided data numbers and a number of items of divided data, the divided data numbers indicate what divided data numbers the items of divided data are among a plurality of items of divided data, and the number of items of divided data is a number of a plurality of items of divided data. Consequently, it is possible to provide a transmitting device and a receiving device which can reduce processing amounts of the devices when transmitting data by using a method such as MMT.