Remote Display Control for Wide-Angle and Detail Image Integration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current remote control systems for telepresence robots lack effective methods to seamlessly integrate and display comprehensive, high-resolution images of a robot's surroundings, leading to blind spots and reduced operator awareness, especially when navigating complex environments.

Innovation Solution

An output control apparatus that communicates with a communication network, receiving and displaying both wide-angle and detailed images from specialized image capturing devices mounted on the robot, allowing for a comprehensive view of the robot's environment and enhancing operator control through a display terminal.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If only a single wide-angle image capturing device is used, then the coverage area is improved, but the image resolution and detail quality deteriorate

Engineering Contradiction:
Improvecoverage areaVSAvoidimage resolution
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The image capturing system is segmented into multiple specialized devices: a first image capturing device for wide-angle coverage and a second image capturing device for high-resolution detailed imaging. This segmentation allows each device to optimize for its specific function, resolving the contradiction between coverage area and image resolution.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the visual field are captured with different quality levels appropriate to their importance. The first image capturing device provides adequate quality for peripheral/wide areas, while the second image capturing device provides high resolution for critical detailed areas, optimizing overall system performance.

Inventive Principle:
Principle #3Local quality

2Loss of information

If multiple image capturing devices are used, then the comprehensive view and detail quality are improved, but the device complexity increases

Engineering Contradiction:
Improvecomprehensive viewVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Multiple image streams from different capturing devices are merged into a single integrated display output. The processing circuitry combines the wide-angle view and detailed views into a unified presentation, maintaining comprehensive information while simplifying the user interface to a single display channel.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The display terminal serves multiple functions: it displays both the wide-angle overview and the detailed high-resolution images, and can switch between or combine these views. This multi-functionality reduces the need for separate dedicated displays for each camera type.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If detailed images from a second image capturing device are integrated, then the blind spots are reduced, but the data transmission and processing load increases

Engineering Contradiction:
Improveoperator awarenessVSAvoiddata transmission load
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

Instead of transmitting all data from both image capturing devices continuously, the system selectively transmits only the necessary detailed images from the second device when relevant to the current view or when enhancement is needed. This partial action approach maintains operator awareness while reducing unnecessary data transmission overhead.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11991477B2Output control apparatus, display terminal, remote control system, control method, and non-transitory computer-readable medium
Publication Date: 2024.05.21 RICOH CO LTD
  • US11991477B2 patent drawing
  • US11991477B2 patent drawing
  • US11991477B2 patent drawing

AI summary

An output control apparatus is communicable with a communication apparatus through a communication network. The communication apparatus includes a first image capturing device configured to capture a subject at a remote site to acquire a first image and a second image capturing device configure to capture a part of the subject to acquire a second image. The output control apparatus includes circuitry to: receive the first image transmitted from the communication apparatus; output the received first image so as to be displayed on a display; receive, from the communication apparatus, the second image acquired by capturing a part of the subject corresponding to a display position of the first image displayed on the display; output the received second image so as to be displayed on the display; and control the display to display the first image and the second image that are output.