Virtual Camera Positioning for Realistic Video Communication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video communication systems often fail to provide a realistic communication experience due to fixed camera positions that are not aligned with the user's gaze, leading to an unnatural viewing experience.

Innovation Solution

The system employs a virtual camera position that can be dynamically adjusted based on the user's gaze direction and body features, using multiple sensors and processing circuitry to render images as if taken from a virtual camera location different from any physical camera, allowing for a more immersive experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If fixed physical camera positions are used, then device complexity is reduced, but the realism of video communication deteriorates

Engineering Contradiction:
Improverealism of video communicationVSAvoidcamera system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent creates a virtual camera that copies the function of a physical camera but operates in software space. Multiple physical cameras capture images, and processing circuitry synthesizes these into a virtual camera view that appears to come from a different position than any actual camera, achieving realistic eye contact without physically relocating cameras.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical approach of physically moving or repositioning cameras with a computational approach. Instead of mechanically adjusting camera positions, the system uses image processing algorithms to synthesize views from virtual camera locations, substituting mechanical movement with digital image manipulation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If physical cameras are moved to align with user gaze, then the realism of video communication is improved, but device complexity and cost increase

Engineering Contradiction:
Improverealism of video communicationVSAvoidmanufacturing complexity
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

Rather than physically moving cameras to match user gaze, the system creates a virtual copy of the camera function through software. The virtual camera position is calculated based on user gaze direction, and image processing generates the appearance of eye contact without any physical camera movement or complex mechanical adjustments.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent substitutes mechanical camera positioning systems with computational image processing. Instead of physically adjusting camera angles and positions to follow user gaze, the system processes images from fixed cameras to create the visual effect of aligned gaze, eliminating complex mechanical positioning mechanisms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If multiple sensors are used to create virtual camera position, then the realism of video communication is improved, but device complexity increases

Engineering Contradiction:
Improverealism of video communicationVSAvoidsensor and processing system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges data from multiple physical cameras and sensors into a single virtual camera view. Image data from multiple cameras, along with gaze direction information from sensors, are combined through processing circuitry to synthesize a unified perspective that achieves realistic eye contact while consolidating multiple input sources into one output.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system makes the camera system multi-functional by having physical cameras serve both as actual imaging devices and as data sources for virtual camera synthesis. The same hardware components perform multiple roles: capturing real images and providing input data for generating virtual perspectives, thereby reducing the need for separate specialized components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11410331B2Systems and methods for video communication using a virtual camera
Publication Date: 2022.08.09 META PLATFORMS TECHNOLOGIES LLC
  • US11410331B2 patent drawing
  • US11410331B2 patent drawing
  • US11410331B2 patent drawing

AI summary

A method for using a virtual camera location to display image data to one device from another device associated with a plurality of cameras. The method includes receiving image data from a plurality of cameras associated with a second user device associated with a second user. The method further includes establishing a virtual camera location different from positions of the plurality of cameras. The method further includes providing an image using the image data on a first user display of a first user device based at least on a viewpoint of the virtual camera location.