AR Object Highlighting for Low-Recognition Remote Viewing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote control systems for telepresence robots struggle to effectively highlight specific objects within captured images that may have lower recognition levels for operators, leading to potential distractions and reduced operational efficiency.

Innovation Solution

An output control apparatus and system that acquires image data from image capture devices, detects target objects, estimates recognition levels, and outputs screen-display image data with additional information for objects with lower recognition levels, using augmented reality to enhance visibility and reduce distractions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If additional information is provided for all detected objects, then recognition level is improved, but visual clutter increases and causes distractions

Engineering Contradiction:
Improverecognition levelVSAvoidvisual clutter
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The system applies different information presentation strategies to different objects based on their individual recognition levels. Objects with lower recognition levels receive additional information overlays, while objects with higher recognition levels are displayed without additional information, creating a localized quality approach to information presentation that avoids universal visual clutter

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

Instead of providing information for all detected objects, the system selectively provides additional information only for objects that fall below a threshold recognition level. This partial action approach ensures that information is added only where necessary, preventing excessive visual clutter while still improving recognition for problematic objects

Inventive Principle:
Principle #16Partial or excessive action

2Loss of information

If remote control systems display all captured image data, then complete information is provided, but operational efficiency decreases due to distractions

Engineering Contradiction:
Improveinformation completenessVSAvoidoperational efficiency
Core Design Contradiction:
Loss of informationVSProductivity

Solution Approach 1:

The system maintains information completeness by detecting and displaying all objects, but applies local quality differentiation by providing enhanced information only for objects with lower recognition levels. This selective approach preserves complete information while minimizing distractions that would reduce operational efficiency

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system introduces an intermediary processing layer that analyzes recognition levels and selectively applies information enhancement. This intermediary function acts as a mediator between complete image data and the operator's view, filtering and enhancing only the necessary portions to maintain efficiency

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11354897B2Output control apparatus for estimating recognition level for a plurality of taget objects, display control system, and output control method for operating output control apparatus
Publication Date: 2022.06.07 RICOH CO LTD
  • US11354897B2 patent drawing
  • US11354897B2 patent drawing
  • US11354897B2 patent drawing

AI summary

An output control apparatus includes circuitry configured to acquire image data of a plurality of target objects captured at a site by an image capture device as captured image data; detect the plurality of target objects included in the captured image data; estimate a recognition level of an observing person on the detected plurality of target objects; identify a specific target object having lower recognition level among the detected plurality of target objects based on the estimated recognition level; and output screen-display image data including additional information set for the identified specific target object having lower recognition level, the screen-display image data generated for the acquired captured image data.