Remote Communication System Using Multi-Camera Body Image Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote communication systems fail to provide a realistic sensation of close proximity between participants, as the distance between the projection plane and the person limits the capture of the entire body image, reducing the immersive experience during remote interactions.

Innovation Solution

A remote communication system employing multiple image capturing units, an extraction unit, and a combining unit to capture and combine images, allowing for the projection of a realistic, full-body image, thereby simulating a face-to-face interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If a single camera is used to capture the entire body image, then the field of view must be increased, but the camera cannot be positioned close enough to the screen to create a realistic sensation of close proximity

Engineering Contradiction:
Improvefield of viewVSAvoidrealistic sensation of close proximity
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent divides the image capture function into multiple cameras positioned at different locations. Each camera captures a portion of the body image, and the images are then combined to form a complete full-body image. This segmentation allows each camera to be positioned optimally for capturing specific body portions while collectively achieving comprehensive coverage and realistic proximity sensation.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If the camera is positioned close to the screen, then the realistic sensation is improved, but only part of the body image can be captured

Engineering Contradiction:
Improverealistic sensation of close proximityVSAvoidcomplete body image
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The patent combines images from multiple cameras to create a complete full-body image. By merging the captured images through image processing and synthesis, the system recovers the complete body information that would be lost if only a single camera positioned close to the screen were used.

Inventive Principle:
Principle #5Merging (Combining)

3Loss of information

If multiple cameras are used to capture the entire body image, then the complete body image can be obtained, but the system complexity increases

Engineering Contradiction:
Improvecomplete body imageVSAvoidnumber of image capturing units
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent employs multiple cameras that serve universal functions - each camera can capture different portions of the body image, and any combination of cameras can contribute to the final full-body image. This multi-functionality allows the system to achieve complete body coverage while maintaining flexibility in camera positioning and configuration.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10178347B2Remote communication system, method for controlling remote communication system, and program
Publication Date: 2019.01.08 CANON KK
  • US10178347B2 patent drawing
  • US10178347B2 patent drawing
  • US10178347B2 patent drawing

AI summary

The present invention provides a scheme that allows a person to communicate with another person at a remote site while giving the realistic sensation as if the persons faced each other in close proximity by capturing the images of the person using a plurality of image capturing units.A remote communication system includes a projector configured to project, on to a screen, an image transmitted from a remote site. The screen has a plurality of the front cameras disposed thereon. A CPU performs an extraction process to extract a person part from each of images captured by the front cameras and a combining process to combine the images captured by the front cameras. The remote communication system further includes a projector that projects the image subjected to the extraction process and the combining process onto a screen set in the remote site.