Dynamic Display Area Shape Control for Natural Video Communication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video communication systems fail to provide a natural and comfortable communication experience for users at remote locations, as they lack the ability to dynamically adjust the display area shape based on user state analysis, leading to an unnatural interaction.

Innovation Solution

An information processing apparatus and method that acquires analysis target data from imaging and sensor devices to analyze user states using human visual characteristics, allowing the control unit to dynamically adjust the shape of the display area, such as changing from a rectangular to a circular shape, to enhance the communication experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a fixed rectangular display area is used in video communication, then the device structure is simple, but the communication naturalness and user comfort are insufficient

Engineering Contradiction:
Improvecommunication naturalnessVSAvoiddisplay control complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The display area shape is changed from a fixed rectangular form to a dynamic form that varies according to user state. The control unit adjusts the display area shape in real-time based on analysis results from imaging devices and sensor devices, making the display adaptable to different communication scenarios and user conditions, thereby improving communication naturalness.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The shape parameter of the display area is changed based on user state analysis. By analyzing parameters such as user position, gaze direction, and physiological state from imaging and sensor data, the system dynamically adjusts the display area shape parameters to optimize communication effectiveness and user comfort.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If the display area shape is dynamically adjusted based on user analysis, then the communication experience is improved, but the system complexity and processing requirements increase

Engineering Contradiction:
Improvedisplay adaptabilityVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system performs self-adjustment by automatically analyzing user state data from imaging devices and sensor devices, and the control unit independently determines and implements display area shape changes without requiring manual intervention. This self-service mechanism reduces the need for complex external control systems while maintaining high adaptability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system establishes a feedback loop where user state is continuously monitored through imaging and sensor devices, the control unit analyzes this feedback data, and adjusts the display area shape accordingly. This closed-loop feedback mechanism enables the system to adapt to changing user conditions while maintaining manageable complexity through automated decision-making.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If user state analysis is performed using imaging and sensor devices, then the communication naturalness is enhanced, but the data processing load and analysis complexity increase

Engineering Contradiction:
Improveuser state analysis precisionVSAvoiddata processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The control unit performs multiple functions including data acquisition from imaging and sensor devices, user state analysis, and display control within a single integrated component. This multi-functionality reduces the need for separate specialized processing systems, thereby managing complexity while maintaining high measurement precision through comprehensive data analysis.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20230341987A1Information processing apparatus and information processing method
Publication Date: 2023.10.26 SONY GROUP CORP
  • US20230341987A1 patent drawing
  • US20230341987A1 patent drawing
  • US20230341987A1 patent drawing

AI summary

The present technology relates to an information processing apparatus and an information processing method that enable users at remote locations to more naturally communicate with each other.Provided is an information processing apparatus including: a control unit, in which when a captured image captured by an imaging device in one space is displayed in real time by a display device in another space between a first space in which a first imaging device and a first display device are installed and a second space in which a second imaging device and a second display device are installed, the control unit acquires analysis target data obtained from a device installed in at least one of the first space or the second space, analyzes a state of a user by using the acquired analysis target data on the basis of a human visual characteristic, and controls a shape of a display area of the display device on the basis of an analysis result of the state of the user. The present technology can be applied to, for example, a video communication system.