Screen Position Protrusion for Panoramic Image Division

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

MPEG-DASH's Spatial Relationship Description (SRD) extension is unable to accurately describe the positions on a screen of images made up of multiple divided images compatible with encoded streams, particularly for panoramic and celestial sphere images, where regions at the ends cannot be described due to discrete positions.

Innovation Solution

An information processing apparatus and method that sets a position protruding out of the screen as a valid position for images made up of multiple divided images, allowing accurate placement and recognition of these images on the screen by using a setting section or allocator to position decoded images based on predefined screen coordinates.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If MPEG-DASH SRD extension is used to describe positions on screen, then positions of divided images can be described, but positions of images made up of multiple divided images (especially panoramic/celestial sphere images with discrete end positions) cannot be accurately described

Engineering Contradiction:
Improveposition description accuracyVSAvoidcompatibility with encoded streams
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent introduces a new dimension to the coordinate system by allowing positions to protrude out of the screen boundaries. Instead of confining positions strictly within the screen rectangle, the system extends the position space to include regions beyond the screen edges, enabling accurate description of panoramic and celestial sphere images that wrap around the screen boundaries.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent modifies the position parameter definition by allowing coordinates to exceed the traditional screen boundary limits. Position parameters are changed from being constrained within [0, screen_width] and [0, screen_height] to allowing values that protrude beyond these boundaries, thereby enabling description of images where divided regions at both ends represent contiguous content.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If positions on screen of divided images are described using SRD, then spatial adaptation can be realized, but reliable recognition of positions for images made up of multiple divided images cannot be achieved

Engineering Contradiction:
Improvespatial adaptation capabilityVSAvoidposition recognition reliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent performs preliminary action by pre-defining the position parameters for images made up of multiple divided images, including positions that protrude out of the screen. This preliminary setup of extended position parameters enables reliable recognition and correct placement of panoramic and celestial sphere images before actual playback occurs.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary mechanism (the extended position parameter system) that mediates between the SRD description framework and the actual positions of divided images in panoramic/celestial sphere content. This intermediary allows the system to bridge the gap between traditional screen-bound coordinates and the wraparound nature of panoramic images.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of manufacture

If traditional SRD position descriptions are used, then simple divided images can be positioned, but complex image compositions like panoramic and celestial sphere images cannot be managed

Engineering Contradiction:
Improvesimplicity of position descriptionVSAvoidhandling of complex image compositions
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The patent enhances the universality of the position description system by making it capable of handling both simple divided images and complex panoramic/celestial sphere compositions through the same extended coordinate framework. The position parameter system becomes multi-functional, accommodating various image types without requiring separate description mechanisms.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10757463B2Information processing apparatus and information processing method
Publication Date: 2020.08.25 SONY GROUP CORP
  • US10757463B2 patent drawing
  • US10757463B2 patent drawing
  • US10757463B2 patent drawing

AI summary

There is provided an information processing apparatus and an information processing method which are capable of reliably recognizing the position on a screen of an image made up of a plurality of divided images or the positions on the screen of divided images compatible with encoded streams. A position protruding out of a screen is set as the position on the screen of an end image that is made up of a left end image and a right end image compatible with encoded streams. The present disclosure is applicable to a file generating apparatus, etc. of an information processing system that distributes encoded streams of an entire celestial sphere image as an image of a moving-image content to a moving-image playback terminal according to a process equivalent to MPEG-DASH, for example.