Adaptive Image Display for Video Conferencing Gaze Correction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing bidirectional communication systems fail to account for the size and placement of display units, as well as viewer gaze positions, leading to unnatural and potentially strange displays during video conferencing, where the height difference between the display user and viewer can disrupt a realistic communication experience.
Innovation Solution
An image processing apparatus that acquires display area information, analyzes input images, and determines optimal display modes based on display unit size, placement, and viewer gaze positions to generate output images that adjust for full-size displays and correct line of sight positions, ensuring a natural and comfortable viewing experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If life-size display is implemented without considering display unit shape, placement location, and viewer gaze position, then the display user can be shown in actual size, but the gaze height difference becomes large causing unnatural communication experience
Solution Approach 1:
The patent applies dynamics by making the display mode adaptive rather than fixed. The system dynamically adjusts between full-size display mode and composition-priority display mode based on real-time detection of gaze height difference. When the gaze height difference exceeds a threshold, the system switches from rigid life-size display to flexible composition-based display, allowing the display behavior to respond dynamically to changing viewer conditions.
Solution Approach 2:
The patent changes display parameters based on detected conditions. Specifically, it monitors the gaze height difference parameter and uses this information to adjust display parameters such as cropping regions, scaling factors, and composition settings. When gaze height difference is within acceptable range, full-size display parameters are used; when exceeded, composition-priority parameters are applied to maintain natural appearance.
2Manufacturing precision
If full-size display is used regardless of display area, then the object can be displayed in actual size, but parts of the object may be cut off or missing
Solution Approach 1:
The system dynamically adjusts display completeness based on available display area. When operating in full-size display mode with sufficient display area, complete object representation is achieved. When display area constraints are detected or when switching to composition-priority mode, the system adaptively crops or adjusts the display region to balance size accuracy with object completeness, ensuring no critical parts are lost.
Solution Approach 2:
The patent applies partial action by selectively displaying different portions of the object depending on the display mode and available space. In composition-priority mode, instead of attempting to show the entire object which would compromise size accuracy, the system strategically selects and displays the most important portions (such as face and upper body for video conferencing), accepting partial representation to maintain overall display quality.
3Device complexity
If display mode is fixed without adaptation, then the system is simple to implement, but it cannot adapt to different display units and viewing conditions
Solution Approach 1:
The patent implements dynamics by transitioning from a static, fixed display mode to a dynamic, adaptive system. The display mode determination unit continuously evaluates current conditions (gaze height difference, display area availability) and automatically selects the appropriate display mode. This dynamic adaptation enables the system to handle diverse display units and viewing conditions while maintaining relatively simple implementation through automated decision-making rather than complex manual configuration.
Solution Approach 2:
The system applies self-service by automatically detecting its own operational conditions and making autonomous decisions about display mode selection. The display mode determination unit monitors gaze height difference and display area parameters, then self-adjusts the display configuration without requiring external intervention or complex user setup. This self-service capability provides adaptability while keeping the system implementation straightforward.
Data Source
AI summary
To make an object image to be displayed on an image processing apparatus that executes bidirectional communication, for example, an optimum display image according to types of information of a display unit, an object, a viewer, and the like. A display area information acquisition unit acquires display area information of the display unit, and an image acquisition unit acquires an input image including the object to be displayed on the display unit. Further, an image information analysis unit executes input image analysis processing, and a display mode determination unit determines a display mode of the object to be displayed on the display unit, applying an analysis result, and displays an output image generated according to the determined display mode on the display unit. Processing for a missing portion of the object in the case of performing full-size display, correction of a line of sight position, and the like are executed.