Image Processing Apparatus Viewpoint Transition Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

During the display of wide viewing angle images, such as VR and panorama images, the recommended viewpoint is difficult to recognize in a freely viewable state without the use of frames, leading to an inconvenient interpretation of the image.

Innovation Solution

An image processing apparatus that includes a detection unit for viewpoint shift information, an output range determination unit that determines the output range based on recommended viewpoint information and viewpoint shift information, and an output unit that outputs the image to a display unit, ensuring the image remains within a recommended range under specific conditions, allowing for the combined use of recommended and free viewpoints without framing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a frame or marker is used to display the recommended viewpoint position, then the recommended viewpoint becomes recognizable, but the interpretation of the world in the image collapses at the corresponding portion

Engineering Contradiction:
Improverecognizability of recommended viewpointVSAvoidcollapse of world interpretation
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent extracts the recommended viewpoint information from the visual display and encodes it in audio information. The audio signal contains directional cues that guide the user's attention to the recommended viewpoint without occupying visual space, thus avoiding the collapse of world interpretation while maintaining recognizability.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces audio information as an intermediary carrier to convey recommended viewpoint information. Instead of directly displaying visual markers that interfere with the image, the system uses audio as a mediator to transmit directional guidance, allowing the visual field to remain intact while providing viewpoint recommendations.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the display shows only the recommended viewpoint, then the recommended range is emphasized, but the free viewpoint capability is restricted

Engineering Contradiction:
Improveaccuracy of recommended viewpoint guidanceVSAvoidfree viewpoint capability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent makes the audio signal serve multiple functions: it provides both the recommended viewpoint guidance and maintains compatibility with free viewpoint exploration. The audio cues work whether the user is viewing the recommended range or exploring other areas, allowing the system to guide without restricting user autonomy.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent dynamically adjusts the audio output based on the user's viewing position and the relationship between the current viewpoint and the recommended viewpoint. The audio guidance adapts in real-time to maintain effectiveness while allowing free exploration, rather than forcing a fixed viewing path.

Inventive Principle:
Principle #15Dynamics

3Reliability

If the output range is fixed to match the recommended range, then the recommended viewpoint is always displayed, but the user cannot freely explore other areas

Engineering Contradiction:
Improveconsistency of recommended viewpoint displayVSAvoiduser freedom in exploration
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent dynamically adjusts the output range based on real-time user input and the relationship between the current and recommended viewpoints. When the user views the recommended range, the output range aligns with it for consistent guidance. When the user explores other areas, the output range adapts to follow the user's viewpoint, maintaining both consistency of recommendation and freedom of exploration.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12159365B2Image processing apparatus, image processing method, and program
Publication Date: 2024.12.03 SONY GROUP CORP
  • US12159365B2 patent drawing
  • US12159365B2 patent drawing
  • US12159365B2 patent drawing

AI summary

Combined use of a recommended viewpoint and a free viewpoint is achieved without display of a position of the recommended viewpoint using a frame or the like.A detection unit detects a viewpoint position change instruction. An output unit outputs a part of an image to a display unit. In this case, an output range (an image range corresponding to a current viewpoint) is changed according to a viewpoint position change unit instruction after output of a recommended range such that the output range transits in a direction toward the recommended range on the basis of a predetermined condition. For example, the predetermined condition is deviation of the output range from the recommended range. Moreover, for example, a transition speed is controlled such that return to the recommended range is achieved faster as a positional difference between the output range and the recommended range becomes larger.