Dynamic Under-Display Camera Activation for Video Calls

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video conferencing systems face challenges in camera placement, where the limited location of cameras can lead to an unnatural viewing experience, as the viewer may appear to be looking away from the speaker, affecting the sincerity and realism of communication.

Innovation Solution

A computer-implemented method to dynamically activate under-screen cameras, determining the best effect region for each camera and adjusting the feed display areas to ensure the camera closest to the speaker is activated, mimicking direct eye contact and improving the realism of video conferencing.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a camera is placed at a fixed location on the device, then the device structure is simple, but the viewer may appear to be looking away from the speaker, affecting the realism of communication

Engineering Contradiction:
Improvecamera placement simplicityVSAvoidrealism of communication
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent implements dynamic camera selection by continuously monitoring the position of the active speaker on the display and switching between multiple under-display cameras based on which camera's best effect region contains the speaker. This dynamic adaptation allows the system to maintain realistic eye contact appearance regardless of speaker position, resolving the contradiction between simple fixed placement and realistic communication.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent divides the display area into multiple best effect regions, each associated with a specific camera. By segmenting the viewing area and assigning different cameras to different regions, the system enables selective activation of appropriate cameras based on speaker location, thereby maintaining communication realism without requiring a single complex fixed camera placement.

Inventive Principle:
Principle #1Segmentation

2Reliability

If multiple cameras are placed on the device to improve viewing experience, then the realism of communication is improved, but the device complexity increases

Engineering Contradiction:
Improverealism of communicationVSAvoidcamera system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system dynamically activates only the specific camera needed based on the current speaker's position, rather than continuously operating multiple cameras or requiring complex mechanical switching mechanisms. This dynamic software-controlled selection reduces device complexity while maintaining communication realism through appropriate camera choice.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Multiple under-display cameras serve the universal function of capturing video feed, with each camera capable of being activated depending on speaker position. This multi-functionality allows the system to handle various speaker positions with a standardized camera setup, reducing overall device complexity compared to dedicated cameras for each position.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If the camera location is fixed, then the device structure is simple, but the viewing experience becomes unnatural when the speaker moves to different positions

Engineering Contradiction:
Improvecamera system structureVSAvoidviewing experience quality
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The system continuously monitors speaker position and dynamically determines which camera should be active based on which best effect region contains the speaker. This dynamic adaptation ensures natural viewing experience regardless of speaker position, while the underlying camera hardware remains simple and fixed in the display.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Different regions of the display are assigned to different cameras based on their best effect regions. When the speaker is in a particular region, the corresponding camera is activated. This local quality approach ensures optimal viewing experience for each spatial zone without requiring complex overall system restructuring.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11490035B1Dynamic activation of under-display camera
Publication Date: 2022.11.01 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11490035B1 patent drawing
  • US11490035B1 patent drawing
  • US11490035B1 patent drawing

AI summary

A computer-implemented method is used for each of two or cameras on a device, where a first camera of the two or cameras is located under a display of the device. The method further includes defining, for each camera, a best effect region on the display including a first best effect region for the first camera. The method also includes identifying, for each of one or more feeds, a feed display area including a first feed display area, where each feed display location uses a portion of the display. The method includes activating the first camera for a first feed, wherein the first feed has a first feed display area that overlaps the first best effect region.