Decoding Device Packing Information Priority for 3D Display

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional decoding devices struggle to reliably display packed images, as they either fail to display 3D images correctly when using SEI or violate standards by ignoring cropping information, leading to inconsistent image display across 2D and 3D formats.

Innovation Solution

A decoding device and method that prioritize packing information for identifying and displaying packed images, ensuring accurate display of multiple images within a packed stream by using a control unit to generate and transmit packing information, allowing for reliable 2D and 3D image rendering without standard violations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If cropping information is included in SPS for 2D display compatibility, then 2D display devices can correctly display packed images, but 3D display devices cannot perform 3D display as they are forced to crop only the left-eye image

Engineering Contradiction:
Improvedisplay format compatibilityVSAvoid3D display functionality
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent introduces a new data structure (PictureParameterSet) that acts as an intermediary between the encoded image data and the display device. This structure contains picture cropping information that can be selectively applied based on display type, allowing 2D devices to crop appropriately while 3D devices can override this cropping to access the full packed image for proper 3D display reconstruction

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent makes the cropping behavior dynamic by allowing decoding devices to adjust cropping application based on detected display capabilities. 2D display devices apply cropping as specified in the PictureParameterSet, while 3D display devices detect their capability and disable cropping to reconstruct the original packed image layout, enabling flexible adaptation to different display types

Inventive Principle:
Principle #15Dynamics

2Adaptability or versatility

If Frame packing arrangement SEI is used to indicate packed image structure, then 3D display devices can identify packed images, but 2D display devices that do not use SEI cannot determine whether the image is packed and display it correctly

Engineering Contradiction:
Improvepacked image identificationVSAvoidpacked image structure information
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent makes the PictureParameterSet structure universal by designing it to serve multiple functions: it provides cropping information for 2D display compatibility while simultaneously preserving packed image structure information for 3D display devices. The same data structure adapts its function based on the capabilities of the receiving device, eliminating the need for separate SEI messaging for different device types

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If decoding devices strictly follow standard cropping information in SPS, then standard compliance is maintained, but 3D display functionality is lost as devices cannot ignore cropping to access full packed image

Engineering Contradiction:
Improvestandard complianceVSAvoid3D display capability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent introduces dynamic behavior to the decoding process where devices can adapt their standard compliance based on capability detection. 3D display devices detect their capability and dynamically adjust their interpretation of cropping information, choosing to override standard cropping behavior when 3D capability is detected, thus maintaining standard compliance for 2D devices while enabling 3D functionality

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11601664B2Decoding device and decoding method, and encoding device and encoding method
Publication Date: 2023.03.07 SONY GROUP CORP
  • US11601664B2 patent drawing
  • US11601664B2 patent drawing
  • US11601664B2 patent drawing

AI summary

The present technology relates to a decoding device and a decoding method, and an encoding device and an encoding method that enable images that configure a packed image to be reliably displayed when an encoded stream is decoded and displayed. A decoding unit decodes an encoded data, the encoded data being an encoded packed image in which a plurality of images is packed, and generates the packed image. A display control unit identifies the images that configure the packed image based on packing SEI preferentially used when the packed image is displayed. The present technology can be applied to a decoding device, for example.