Image Processing Apparatus Presenter Occlusion Visibility

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques fail to effectively enhance the visibility of hidden text or descriptions in images, particularly when they are obscured by presenters, due to low bit rates or similar text colors with the background, which limits their effectiveness in maintaining the positional relationship between the presenter and the description.

Innovation Solution

An image processing apparatus that includes a description determination processing unit to identify description portions by analyzing pixel differences, shape, and temporal stability, and a superimposition processing unit to generate and overlay display data, enhancing visibility by reducing resolution, bordering, or color differentiation, while maintaining the presenter's positional relationship.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If existing image processing techniques are applied to enhance text visibility, then text visibility is improved, but the techniques are ineffective when text is hidden by presenters or in low bit rate conditions

Engineering Contradiction:
Improvetext visibilityVSAvoideffectiveness in hidden text conditions
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system performs preliminary actions by detecting the presenter's position and the description field area in advance, then proactively generates and superimposes description information before it becomes completely hidden, ensuring continuous visibility throughout the presentation

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary processing mechanism that detects pixel differences between frames, identifies description portions through shape and temporal stability analysis, and superimposes enhanced description data as an intermediary layer between the original image and the final display, ensuring visibility even when obscured

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If description portions are superimposed to ensure visibility, then visibility of hidden descriptions is improved, but the positional relationship between presenter and description may be disrupted

Engineering Contradiction:
Improvedescription visibilityVSAvoidpositional relationship
Core Design Contradiction:
Measurement precisionVSShape

Solution Approach 1:

The system applies local quality by performing superimposition only in the specific description field area identified through pixel difference analysis, rather than globally affecting the entire image, thus maintaining the presenter's position while enhancing only the description portions that need visibility

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system resolves the positional relationship issue by transitioning to another dimension - using temporal analysis across multiple frames to track the description field's position and maintain its spatial relationship with the presenter while ensuring visibility through frame-by-frame superimposition

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS11659134B2Image processing apparatus and image processing method
Publication Date: 2023.05.23 SONY GROUP CORP
  • US11659134B2 patent drawing
  • US11659134B2 patent drawing
  • US11659134B2 patent drawing

AI summary

Visibility of a description on a description field hidden by a presenter is to be ensured while maintaining a positional relationship between the presenter and the description on the description field.The moving image data obtained by imaging a state where the presenter is giving the description onto the description field is processed to determine the description portion. Display data for displaying each of portions determined to be the description portion as a description is generated and superimposed on moving image data. For example, a difference value for each of pixels between a current frame image and a reference frame image is extracted, a group including a series of consecutive pixels having a difference value being a threshold or more is grasped and then, whether or not the group is a description portion is determined for each of the groups.