Video Communication Display Positioning for Realistic Presence

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video communication systems fail to provide a realistic sense of presence as if the partner is in one's sight, leading to unnatural viewing experiences due to improper display sizing and positioning.

Innovation Solution

The system adjusts display ranges and positions based on physical size and installation position of displays, using camera and image analysis to calculate and ensure the partner's face is displayed at an appropriate height, simulating a virtual standing position, thereby providing a life-size and realistic view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the partner's video is displayed at a large size to enhance realism, then the sense of presence is improved, but the display position may become inappropriate (e.g., face too high or too low)

Engineering Contradiction:
Improvesense of presenceVSAvoiddisplay position accuracy
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The display range is dynamically adjusted based on the detected face position and distance. The system continuously monitors the partner's face location in the video stream and automatically modifies the display parameters to maintain the face at an appropriate vertical position (e.g., eye level) while preserving the desired display size for realism.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes display parameters (position, size, scaling) based on calculated distance and face position data. By adjusting these parameters dynamically, the system achieves both large display size for realism and correct positioning, resolving the contradiction between these two requirements.

Inventive Principle:
Principle #35Parameter changes

2Area of stationary object

If the display range is adjusted to show the partner's full body, then completeness of view is improved, but the face may be displayed at an unnatural height

Engineering Contradiction:
Improvedisplay areaVSAvoidface position accuracy
Core Design Contradiction:
Area of stationary objectVSManufacturing precision

Solution Approach 1:

The system applies different quality requirements to different parts of the display. The face region is given priority for correct positioning at eye level, while other parts of the body can be displayed at relative positions. This local quality approach allows the face to be correctly positioned even when showing the full body.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system transitions from displaying the entire body at uniform scale to a dimensionally adjusted view where the face is positioned at the correct vertical level while the body extends above and below. This may involve cropping, scaling, or composite display techniques to achieve proper face positioning while maintaining body completeness.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Manufacturing precision

If facial recognition is used to guide user position, then viewing position accuracy is improved, but the system complexity increases

Engineering Contradiction:
Improveviewing position accuracyVSAvoidsystem complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The system performs self-adjustment by automatically detecting the face position and distance, then autonomously modifying the display parameters without requiring external intervention or complex user guidance systems. This self-service approach reduces system complexity while maintaining high positioning accuracy.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses feedback from face detection and distance calculation to continuously adjust display parameters. This closed-loop feedback mechanism enables accurate positioning without requiring complex pre-programming or manual configuration, simplifying the overall system while achieving high precision.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3493533B1Information processing device, information processing method, and program
Publication Date: 2024.04.03 SONY GROUP CORP
  • EP3493533B1 patent drawingFigure 1~2
  • EP3493533B1 patent drawingFigure 3
  • EP3493533B1 patent drawingFigure 4

AI summary

[Object] To provide an information processing device, an information processing method, and a program capable of giving a sense of realism as if a partner connected in video communication is present in one's sight. [Solution] An information processing device including: a communication unit configured to transmit and receive an image to and from a communication connection destination; and a control unit configured to control a display range and a position of the image, on the basis of a display size and installation position information of a display device that displays the image, and distance information of a subject appearing in the image that is acquired from the image.