Multi-Display Communication System for Realistic Interaction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing multimedia terminals lack realism in user communication and face challenges in accurately and simply transmitting information, such as verbal descriptions of locations, due to limited visual feedback.

Innovation Solution

An information display system with interconnected terminals that capture and display images of users' and operators' faces and upper bodies, along with their hands, using multiple cameras and displays to create a sense of realism and facilitate accurate information transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If only a picture of the operator's face is displayed, then the display content is simple, but the sense of realism in communication is insufficient

Engineering Contradiction:
Improvesense of realism in communicationVSAvoiddisplay configuration
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The display is divided into multiple independent display units: a first display showing the operator's face and upper body, and a second display showing the operator's hands and input panel. This segmentation allows each display to focus on specific visual information, enhancing the overall sense of realism without requiring a single complex display system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from a single-dimensional face display to a multi-dimensional visual presentation by adding a second display dimension that shows the operator's hands and input panel. This dimensional expansion provides comprehensive visual feedback, making the communication feel more natural and immersive.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If only verbal instruction is used to transmit location information, then the communication method is simple, but the accuracy of location transmission is poor

Engineering Contradiction:
Improveaccuracy of location transmissionVSAvoidinformation transmission method
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The operator's hands and input panel serve as an intermediary visual medium between the operator and user. By displaying the hands interacting with the input panel, the system provides a visual bridge that translates abstract verbal instructions into concrete visual actions, enabling accurate location and information transmission.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates a visual copy of the operator's hand movements and input panel interactions on the second display. This visual copy allows the user to observe exactly how location information is being selected and transmitted, significantly improving accuracy compared to verbal instructions alone.

Inventive Principle:
Principle #26Copying

3Ease of operation

If multiple cameras and displays are used to capture and show faces and hands, then the sense of realism is enhanced, but the device complexity increases

Engineering Contradiction:
Improvesense of realismVSAvoidnumber of cameras and displays
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The camera system is segmented into dedicated units: first and second cameras for capturing the operator's face and upper body, and third and fourth cameras for capturing the hands and input panel. This segmentation allows each camera to be optimized for its specific capture task while working together to create a comprehensive realistic display.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each display unit serves multiple functions: the first display shows the operator's face and upper body for visual communication, while the second display shows the hands and input panel for interaction guidance. This multi-functionality maximizes the utility of each component, reducing the need for additional specialized devices.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10122966B2Information display system and information display terminal
Publication Date: 2018.11.06 PANASONIC INTELLECTUAL PROPERTY MANAGEMENT CO LTD
  • US10122966B2 patent drawing
  • US10122966B2 patent drawing
  • US10122966B2 patent drawing

AI summary

It is possible to provide a sense of realism that a user actually faces a communication partner and to accurately and simply transmit information. In information display system (5), first display panel (21) displays a face and a part of an upper body of an operator op captured by third camera (63) and second display panel (22) displays hands of operator op captured by fourth camera (64) in information display terminal (10). In information provision terminal (50), third display panel (53) displays a face of the user captured by first camera (31), and fourth display panel (54) displays hands of the user captured by second camera (32).