Image Processing Apparatus Orientation Adaptation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face difficulties in generating synthesized images that accurately represent the transition of operations, such as golf swings or baseball games, especially when the imaging range is not aligned with the subject's orientation, leading to suboptimal results when the subject is photographed with a vertical or horizontal orientation that does not match the standard horizontal shooting mode.

Innovation Solution

An image processing apparatus and method that acquires imaging operation state information, performs image processing based on this information to adjust image orientation and size, and synthesizes images to align with user-preferred composition, allowing for the generation of high-quality synthesized images regardless of the imaging orientation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If images are photographed with vertical orientation to match user composition preference, then user satisfaction is improved, but the ability to generate synthesized images representing operation transition deteriorates

Engineering Contradiction:
Improveuser composition preferenceVSAvoidsynthesized image generation accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system dynamically adjusts the synthesis process based on the imaging operation state. When vertical orientation images are detected, the synthesis unit automatically rotates and repositions images to achieve proper alignment for representing operation transitions, making the system adaptable to different shooting orientations while maintaining synthesis accuracy

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes processing parameters based on imaging orientation. The synthesis unit modifies rotation angles, positioning coordinates, and synthesis methods according to whether images are captured in horizontal or vertical orientation, enabling proper synthesized image generation from vertically oriented source images

Inventive Principle:
Principle #35Parameter changes

2Reliability

If images are photographed with horizontal orientation as in standard shooting mode, then synthesized image generation is improved, but user composition preference flexibility deteriorates

Engineering Contradiction:
Improvesynthesized image generation accuracyVSAvoidcomposition flexibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The synthesis unit is designed to handle multiple imaging orientations universally. It can process both horizontally and vertically oriented images by automatically detecting the orientation state and applying appropriate transformation operations, making the system versatile for different composition preferences while maintaining reliable synthesized image generation

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If image processing is performed without considering imaging operation state, then processing simplicity is improved, but image alignment and sizing accuracy deteriorates

Engineering Contradiction:
Improveprocessing complexityVSAvoidimage alignment accuracy
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The system performs preliminary detection of the imaging operation state (orientation, subject position, movement direction) before executing the synthesis process. This preliminary information is used to pre-calculate rotation angles and positioning parameters, ensuring accurate image alignment and sizing in the subsequent synthesis step

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8670047B2Image processing apparatus, imaging apparatus, image processing method, and program
Publication Date: 2014.03.11 SONY GROUP CORP
  • US8670047B2 patent drawing
  • US8670047B2 patent drawing
  • US8670047B2 patent drawing

AI summary

An image processing apparatus includes an imaging operation state acquiring unit that acquires imaging operation state information representing imaging operation states at the time of an imaging operation for a plurality of images that are consecutively generated in a time series, an image processing unit that performs image processing, which is used for generating a synthesized image representing transition in a specific operation of an observed subject included in the plurality of images, based on the acquired imaging state information for the plurality of images, and an image synthesis unit that generates a synthesized image by synthesizing the plurality of images for which the image processing has been performed.