Remote Sensor Image Overlay for Left-Right Orientation Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Operators performing remote work based on sensor images from moving bodies, such as vehicles, often make incorrect decisions regarding left and right orientations with respect to the front of the moving body due to misunderstandings of image correspondences.

Innovation Solution

A remote image display method that sets reference lines and defines right and left regions in sensor images, superimposing recognition assistances with different colors on these regions to clearly differentiate them, thereby reducing operator confusion.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If sensor images are displayed without additional visual cues, then the display system remains simple, but operators make incorrect decisions about left and right orientations

Engineering Contradiction:
Improvedecision accuracyVSAvoiddisplay system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies color coding to recognition assistances displayed on the sensor image. Different colors are assigned to indicate different spatial regions (e.g., right side vs. left side of the moving body), enabling operators to quickly and accurately identify orientations without complex additional hardware or interfaces.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent segments the sensor image into multiple regions corresponding to different spatial zones around the moving body (front, rear, left, right). Each region is marked with distinct visual cues, allowing operators to systematically process spatial information and reduce orientation errors.

Inventive Principle:
Principle #1Segmentation

2Ease of operation

If reference lines and recognition assistances are added to the display, then operator understanding of spatial orientation improves, but the processing complexity increases

Engineering Contradiction:
Improvespatial orientation understandingVSAvoidimage processing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent creates a simplified visual representation (copy) of the spatial environment by overlaying reference lines and recognition assistances on the sensor image. This copied spatial model helps operators understand the real-world orientation without requiring them to mentally process the raw sensor data directly.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The reference lines and recognition assistances act as intermediary visual elements between the raw sensor image and the operator's spatial understanding. These intermediaries translate complex sensor data into intuitive visual cues that bridge the gap between machine perception and human comprehension.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS12266035B2Remote image display method and remote image display system
Publication Date: 2025.04.01 TOYOTA JIDOSHA KK
  • US12266035B2 patent drawing
  • US12266035B2 patent drawing
  • US12266035B2 patent drawing

AI summary

A sensor image generated based on data obtained from a remote sensor is displayed on a display of a terminal communicating with the remote sensor. The remote sensor includes a sensor mounted on a moving body. The sensor image includes a moving body image representing an image generated based on data obtained from the sensor mounted on the moving body. In the moving body image, right and left regions are set with respect to front of the moving body. Right and left recognition assistances are superimposed respectively on the right and left regions. A color of the right recognition assistance is different from a color of the left recognition assistance.