Image Processing Apparatus Panoramic Compositing Method

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies fail to effectively enhance user interest in viewing multiple moving pictures by not providing a comprehensive representation of the imaging environment, including surrounding atmosphere and objects, leading to decreased engagement.

Innovation Solution

An image processing apparatus and method that transforms and composites multiple images from a moving picture into a panoramic view, using transformation information to align images around a reference image, and includes features like object detection to prevent overwriting of objects, enhancing the display with decoration images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If thumbnail images of still images are displayed in playback point-in-time order, then the overall content of moving pictures can be understood, but the imaging range and surrounding atmosphere cannot be comprehended

Engineering Contradiction:
Improveimaging range informationVSAvoidimage processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent segments the moving picture into multiple still images (compositing target images) and processes them individually. Each still image is transformed and composited separately to create a panoramic view that represents the imaging range and surrounding atmosphere at different time points, thereby preserving spatial information that would otherwise be lost in sequential thumbnail playback.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from temporal sequencing (playing images in time order) to spatial arrangement (displaying images in a panoramic view). By transforming still images into a panoramic composition, the system adds a spatial dimension that allows viewers to comprehend the imaging range and environment simultaneously, rather than sequentially through time-based thumbnails.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If multiple moving pictures are played to show content from multiple tourist sites, then comprehensive content is provided, but play time is prolonged and interest decreases

Engineering Contradiction:
Improvecontent representationVSAvoidplayback time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent merges multiple still images from different time points into a single panoramic view composition. This consolidation allows the imaging range and surrounding atmosphere from multiple moments to be represented simultaneously in one display, eliminating the need to play through each moving picture sequentially and thereby reducing total viewing time while preserving comprehensive content information.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent performs preliminary processing by transforming and compositing still images into panoramic views before playback. This pre-computation creates condensed visual representations that capture the essence of multiple time points, allowing viewers to grasp comprehensive content information quickly without needing to watch the entire moving pictures from start to finish.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If thumbnail images are displayed to represent scenes, then playback order is maintained, but other imaging spaces and surrounding atmosphere are not displayed

Engineering Contradiction:
Improveplayback controlVSAvoidsurrounding atmosphere information
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent applies local quality by transforming each still image individually to create a panoramic view that preserves the specific characteristics of that moment's imaging range and surrounding atmosphere. Each compositing target image is processed with attention to its local details, ensuring that the surrounding atmosphere and spatial information are maintained while still representing the temporal sequence through the ordering of compositing target images.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9106872B2Image processing apparatus, image processing method, and program
Publication Date: 2015.08.11 SONY GROUP CORP
  • US9106872B2 patent drawing
  • US9106872B2 patent drawing
  • US9106872B2 patent drawing

AI summary

An image processing apparatus includes: a front-most image information storage unit configured to store information relating to a front-most image that is one image of a plurality of compositing target images serving as compositing targets of an imaged image making up an imaged moving picture; a transformation information storage unit configured to store transformation information used for transforming another compositing target image of the plurality of compositing target images with the front-most image as a reference; an image transforming unit configured to transform the plurality of compositing target images sequentially toward the front-most image from the compositing target image positioned at the forefront or last of the temporal axis based on the transformation information; an image compositing unit configured to overwrite-composite the transformed compositing target images sequentially to generate a composited image; and a display control unit configured to display the composited image sequentially.