Dynamic Display Region Adjustment for Parallel Content and Video

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for displaying content and communication images in parallel, such as PIP or POP, often result in hidden content and reduced image quality due to limited screen space, making it difficult to identify users and maintain image quality.

Innovation Solution

An information processing apparatus and method that detects the number of users in a captured image, sets appropriate display regions, and generates a display image by extracting user face portions, ensuring content is not partially hidden and image quality is maintained by adjusting the size and arrangement of images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If PIP or POP display method is used to display content and communication image in parallel, then both content and communication image can be displayed simultaneously, but content is hidden by communication image and image quality deteriorates

Engineering Contradiction:
Improveparallel display capabilityVSAvoidcontent visibility
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The display screen is divided into multiple regions: a first display region for content and a second display region for communication images. This segmentation allows both content and communication images to be displayed simultaneously without overlapping, preventing content from being hidden while maintaining parallel display capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of overlaying communication images on top of content (single-layer approach), the patent uses a multi-region spatial arrangement where content and communication images are placed in different areas of the display screen. This dimensional separation eliminates the hiding problem while preserving simultaneous display.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If communication image region is limited in display screen, then parallel display is enabled, but communication image size is reduced and user identification becomes difficult

Engineering Contradiction:
Improveparallel display capabilityVSAvoiduser identification accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent extracts and displays only the face regions of users from the communication image, rather than displaying the entire communication image. This extraction of relevant information (faces) allows user identification to be performed effectively even when the communication image occupies a limited display region.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Instead of uniformly displaying the entire communication image, the patent applies local quality enhancement by specifically enlarging and emphasizing face regions within the communication image. This allows critical identification information to be clearly visible while maintaining the limited overall region allocation for communication images.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If communication image size is increased to improve user identification, then image quality improves, but content display area is reduced and content becomes hidden

Engineering Contradiction:
Improveuser identification accuracyVSAvoidcontent visibility
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The display screen is divided into multiple regions: a first display region for content and a second display region for communication images. This segmentation allows both content and communication images to be displayed simultaneously without overlapping, preventing content from being hidden while maintaining parallel display capability.

Inventive Principle:
Principle #1Segmentation

4Measurement precision

If face regions are extracted and displayed for multiple users, then user identification becomes easier, but display image complexity increases

Engineering Contradiction:
Improveuser identification accuracyVSAvoiddisplay image processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and displays only the face regions of users from the communication image, rather than displaying the entire communication image. This extraction of relevant information (faces) allows user identification to be performed effectively even when the communication image occupies a limited display region.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP2437490B1Information processing apparatus and information processing method
Publication Date: 2018.05.30 SATURN LICENSING LLC
  • EP2437490B1 patent drawingFigure 1
  • EP2437490B1 patent drawingFigure 2
  • EP2437490B1 patent drawingFigure 3

AI summary

An information processing apparatus may include an obtaining unit to obtain a number of users from information on detection of a face region including a face in a captured image provided at the apparatus. The apparatus also may include a setting unit to set a display region for content and a display region for a captured image in a display screen; and a display image generation unit to generate a display image to be displayed in the display region for a captured image, in accordance with the information on the detection, the number of users, and the display region set for a captured image.