Image Region Extraction for Immersive Content Information Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users engaging with immersive content through image display technologies, such as head-mounted displays, face challenges in recognizing notices and advertisements without disrupting their focus on the primary content, as additional images may cause discomfort or require significant line-of-sight shifts.

Innovation Solution

An image processing apparatus and system that extracts a region of non-interest from the moving image and overlays a different image in this area, using a server to calculate viewing rates based on user line-of-sight changes, ensuring information is presented effectively without hiding the object of interest and maintaining realistic immersion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If an additional image carrying information is brought into the user's field of view, then information such as notices and advertisements can be presented, but the content may be partially hidden causing discomfort or botheration

Engineering Contradiction:
Improveinformation presentationVSAvoidcontent hiding and discomfort
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent divides the display field into a content display region and an information display region. The information is presented in a separate region rather than overlaying the content, allowing both content and information to be visible simultaneously without mutual interference. This segmentation resolves the contradiction by preventing content hiding while enabling information presentation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent utilizes the vertical dimension of the display field by positioning the information display region in the lower portion while the content occupies the upper portion. This dimensional separation allows the user to view both content and information without line-of-sight shifts, resolving the contradiction between information visibility and content完整性.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Object-affected harmful factors

If the additional image is displayed in a separate region within the screen, then information can be presented without hiding content, but the user must shift line of sight far from the content which causes the additional image to fail to draw attention

Engineering Contradiction:
Improvecontent visibilityVSAvoidline-of-sight shift requirement
Core Design Contradiction:
Object-affected harmful factorsVSEase of operation

Solution Approach 1:

The patent applies local quality by creating distinct visual regions with different functional characteristics. The content region maintains normal display properties for immersive content viewing, while the information region is positioned to be naturally visible within the same field of view. This local differentiation allows information to be presented without requiring significant line-of-sight shifts from the content.

Inventive Principle:
Principle #3Local quality

3Adaptability or versatility

If a head-mounted display is used to display panoramic video image, then the sense of immersion is enhanced, but recognizing notices and advertisements becomes difficult without disrupting focus on primary content

Engineering Contradiction:
Improveimmersive content displayVSAvoidnotice and advertisement recognition
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent segments the panoramic display field into distinct content and information regions. The information display region is positioned in the lower portion of the field of view, allowing users to recognize notices and advertisements while maintaining focus on the immersive content. This segmentation enables both immersive content display and information recognition simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary information display region that mediates between the immersive content and the information presentation requirements. This intermediate region allows information to be conveyed without disrupting the immersive experience, as it is integrated into the overall field of view rather than overlaying the content.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11847715B2Image processing apparatus, image distribution system, and image processing method
Publication Date: 2023.12.19 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11847715B2 patent drawing
  • US11847715B2 patent drawing
  • US11847715B2 patent drawing

AI summary

In an image processing apparatus, a region extraction part extracts an image of the sky as an image of a target object not included in an object of interest in a moving image of content, on the basis of at least any of changes in pixel values, a frequency at which a line of sight is directed, a distance from a camera, registered information designating the target object, and the like. In the extracted region, a different image presentation part displays an image indicative of a magnified image of a player and character information for cheering as an image different from the sky image.